Abstract

This paper presents a comparative analysis of the performance of Equivariant Quantum Neural Networks (EQNNs) and Quantum Neural Networks (QNNs), juxtaposed against their classical counterparts: Equivariant Neural Networks (ENNs) and Deep Neural Networks (DNNs). We evaluate the performance of each network with three two-dimensional toy examples for a binary classification task, focusing on model complexity (measured by the number of parameters) and the size of the training dataset. Our results show that the $\mathbb{Z}_{2}\times\mathbb{Z}_{2}$ EQNN and the QNN provide superior performance for smaller parameter sets and modest training data samples.

1 1 0 Academic Editor: Mariam Zomorodi 25 January 2024 2 March 2024 8 March 2024 https://doi.org/ 13 3 188 Academic Editor: Mariam Zomorodi 25 January 2024 2 March 2024 8 March 2024 13 March 2024 https://doi.org/10.3390/axioms13030188 $\mathbb{Z}_{2}\times\mathbb{Z}_{2}$ Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networks $\mathbb{Z}_{2}\times\mathbb{Z}_{2}$ Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networks Zhongtian Dong ${}^{1,*,\dagger}$, Marçal Comajoan Cara ${}^{2,\dagger}$, Gopal Ramesh Dahale ${}^{3,\dagger}$, Roy T. Forestano ${}^{4,\dagger}$, Sergei Gleyzer ${}^{5,\dagger}$, Daniel Justice ${}^{6,\dagger}$, Kyoungchul Kong ${}^{1,\dagger}$, Tom Magorsch ${}^{7,\dagger}$, Konstantin T. Matchev ${}^{4,}$${}^{,\dagger}$, Katia Matcheva ${}^{4,\dagger}$ and Eyup B. Unlu ${}^{4,\dagger}$ Zhongtian Dong, Marçal Comajoan Cara, Gopal Ramesh Dahale, Roy Forestano, Sergei Gleyzer, Daniel Justice, Kyoungchul Kong, Tom Magorsch, Konstantin Matchev, Katia Matcheva and Eyup Unlu Dong, Z.; Cara, M.C.; Dahale, G.R.; Forestano, R.T.; Gleyzer, S.; Justice, D.; Kong, K.; Magorsch, T.; Matchev, K.T.; Matcheva, K.; et al. Correspondence: cdong@ku.edu (Z.D.) These authors contributed equally to this work. 81P68 and 68Q12

1 Introduction

The rapidly evolving convergence of machine learning (ML) and high-energy physics (HEP) offers a range of opportunities and challenges for the HEP community. Beyond simply applying traditional ML methods to HEP issues, a fresh cohort of experts skilled in both areas is pioneering innovative and potentially groundbreaking approaches. ML methods based on symmetries play a crucial role in improving data analysis as well as expediting the discovery of new physics Shanahan et al. (2022); Feickert and Nachman (2021). In particular, classical Equivariant Neural Networks (ENNs) exploit the underlying symmetry structure of the data, ensuring that the input and output transform consistently under the symmetry Cohen and Welling (2016). ENNs have been widely used in various applications including deep convolutional neural networks for computer vision Krizhevsky et al. (2012), AlphaFold for protein structure prediction Jumper et al. (2021), Lorentz equivariant neural networks for particle physics Bogatskiy et al. (2020), and many other HEP applications Cohen et al. (2019); Boyda et al. (2021); Favoni et al. (2022); Dolan and Ore (2021); Bulusu et al. (2021).

Meanwhile, the rise of readily available noisy intermediate-scale quantum computers Preskill (2018) has sparked considerable interest in using quantum algorithms to tackle high-energy physics problems. Modern quantum computers boast impressive quantum volume and are capable of executing highly complex computations, driving a collaborative effort within the community Feynman (1982); Georgescu et al. (2014) to explore their applications in quantum physics, particularly in addressing theoretical challenges in particle physics. Recent research on quantum algorithms for particle physics at the Large Hadron Collider (LHC) covers a range of tasks, including the evaluation of Feynman loop integrals Ramírez-Uribe et al. (2022), simulation of parton showers Bepari et al. (2022) and structure Li et al. (2022), development of quantum algorithms for helicity amplitude assessments Bepari et al. (2021), and simulation of quantum field theories Jordan et al. (2014); Preskill (2018); Bauer et al. (2021); Abel et al. (2021); Abel and Spannowsky (2021); Davoudi et al. (2021).

An intriguing prospect in this realm is the emerging field of quantum machine learning (QML), which harnesses the computational capabilities of quantum devices for machine learning tasks. With classical machine learning algorithms already proving effective for various applications at the LHC, it is very natural to explore whether QML can enhance these classical approaches Mott et al. (2017); Blance and Spannowsky (2020); Wu et al. (2021); Blance and Spannowsky (2021); Abel et al. (2022); Wu et al. (2021); Chen et al. (2021); Terashi et al. (2021); Araz and Spannowsky (2022); Ngairangbam et al. (2022). In recent years, significant development has been made in their quantum counterparts, Equivariant Quantum Neural Networks (EQNNs) Nguyen et al. (2022); Meyer et al. (2023); West et al. (2023); Skolik et al. (2023); Chang et al. (2023).

In this paper we benchmark the performance of EQNNs against various classical and/or non-equivariant alternatives for three two-dimensional toy datasets, which exhibit a $\mathbb{Z}_{2}\times\mathbb{Z}_{2}$ symmetry structure. Such patterns often appear in high-energy physics data, e.g., as kinematic boundaries in the high-dimensional phase space describing the final state Kim (2010); Franceschini et al. (2022). By a clever choice of the kinematic variables for the analysis, these boundaries can be preserved in projections onto a lower-dimensional feature space Kersting (2009); Bisset et al. (2011); Burns et al. (2009); Debnath et al. (2016, 2017). For example, one can form various combinations of possible invariant mass for the generic decay chain considered in Ref. Burns et al. (2009), $D\to jC\to j\ell^{\pm}_{n}B\to j\ell_{n}^{\pm}\ell_{f}^{\mp}A$, where Particles $A$, $B$, $C$, and $D$ are hypothetical particles in new physics beyond the standard model of masses $\{m_{A},m_{B},m_{C},m_{D}\}$, while the corresponding standard model decay products consist of a jet $j$, a “near” lepton $\ell_{n}^{\pm}$, and a “far” lepton $\ell_{f}^{\pm}$. The two-dimensional (bivariate) distribution $\frac{d^2\mathrm{<ruby><rb>\Gamma </rb><rt>がんま</rt></ruby>}}{d{R}_{ij}d{R}_{kl}}$Γがんま𝑑subscript𝑅𝑖𝑗𝑑subscript𝑅𝑘𝑙\frac{d^{2}\Gamma}{dR_{ij}dR_{kl}}divide start_ARG italic_d start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT roman_Γがんま end_ARG start_ARG italic_d italic_R start_POSTSUBSCRIPT italic_i italic_j end_POSTSUBSCRIPT italic_d italic_R start_POSTSUBSCRIPT italic_k italic_l end_POSTSUBSCRIPT end_ARG shows distributions similar to those in Figures 1–3, where $R_{ij}=\frac{m_{i}^{2}}{m_{j}^{2}}$ is the mass square ratio. Symmetric, anti-symmetric, or non-symmetric structures provide information of particle masses involved in the cascade decays.

Figure 1: Pictorial illustration of the first dataset used in this study—the symmetric case (1).

Figure 2: Pictorial illustration of the second dataset used in this study—the anti-symmetric case (4).

Figure 3: Pictorial illustration of the third dataset used in this study—the fully anti-symmetric case (6).

In this study, we consider simplified two-dimensional datasets that mimic the data arising in such projections. This setup allows us to focus on the comparison between different methods, avoiding unnecessary issues that may arise when dealing with actual particle physics simulation data such as sampling statistics, parton distribution functions, unknown particle mass spectrum, unknown width, detector effects, etc. We explore EQNNs and benchmark them against classical neural network models. We find that the variational quantum circuits learn the data better with the smaller number of parameters and the smaller training dataset compared to their classical counterparts.

2 Dataset Description

In all three examples, we consider two-dimensional data $(x_{1},x_{2})$ on the unit square ($-1\leq x_{i}\leq 1$). The data points belong to two classes: $y=+1$ (blue points) and $y=-1$ (red points).

1. Symmetric case:

   In the first example (Figure 1), the labels are generated by the function

   $$y(x_{1},x_{2}) = 2H\left(R-\sqrt{(x_{1}+1)^{2}+(x_{2}-1)^{2}}\right)$$ (1)

   $$+ 2H\left(R-\sqrt{(x_{1}-1)^{2}+(x_{2}+1)^{2}}\right)-1,$$

   where $H(x)$ is the Heaviside step function and for definiteness we choose $R=1.1$. The function (1) respects a $\mathbb{Z}_{2}\times\mathbb{Z}_{2}$ symmetry, where the first $\mathbb{Z}_{2}$ is given by a reflection about the $x_{1}=x_{2}$ diagonal

   $$x_{1}\to x_{2},\qquad x_{2}\to x_{1},\qquad y\to y,$$ (2)

   while the second $\mathbb{Z}_{2}$ corresponds to a reflection about the $x_{1}=-x_{2}$ diagonal

   $$x_{1}\to-x_{2},\qquad x_{2}\to-x_{1},\qquad y\to y.$$ (3)

   This $\mathbb{Z}_{2}\times\mathbb{Z}_{2}$ example was studied in Ref. Meyer et al. (2023) and we shall refer to it as the symmetric case since the $y$ label is invariant.

2. Anti-symmetric case:

   The second example is illustrated in Figure 2. The labels are generated by the function

   $$y(x_{1},x_{2}) =H\left(-x_{1}\right)H\left(-x_{2}\right)+H\left(-x_{1}\right)H\left(x_{2}\right)H(x_{1}+x_{2})$$

   $$-H\left(x_{1}\right)H\left(x_{2}\right)+H\left(x_{1}\right)H\left(-x_{2}\right)H(x_{1}+x_{2}).$$ (4)

   The first $\mathbb{Z}_{2}$ is still realized as in (2). However, this time, the labels are flipped under a reflection along the $x_{1}=-x_{2}$ diagonal:

   $$x_{1}\to-x_{2},\qquad x_{2}\to-x_{1},\qquad y\to-y,$$ (5)

   which is why we shall refer to this case as anti-symmetric.

3. Fully anti-symmetric case:

   The last example is depicted in Figure 3. The labels are generated by the function

   $$y(x_{1},x_{2}) =H\left(x_{1}\right)H\left(x_{2}\right)(2H\left(x_{1}-x_{2}\right)-1)+H\left(-x_{1}\right)H\left(-x_{2}\right)(2H\left(x_{2}-x_{1}\right)-1)$$

   $$+H\left(-x_{1}\right)H\left(x_{2}\right)H\left(x_{1}+x_{2}\right)(2H\left(R-\sqrt{(x_{1}+1)^{2}+(x_{2}-1)^{2}}\right)-1)$$

   $$+H\left(-x_{1}\right)H\left(x_{2}\right)H\left(-x_{1}-x_{2}\right)(1-2H\left(R-\sqrt{(x_{1}+1)^{2}+(x_{2}-1)^{2}}\right))$$ (6)

   $$+H\left(x_{1}\right)H\left(-x_{2}\right)H\left(x_{1}+x_{2}\right)(1-2H\left(R-\sqrt{(x_{1}-1)^{2}+(x_{2}+1)^{2}}\right))$$

   $$+H\left(x_{1}\right)H\left(-x_{2}\right)H\left(-x_{1}-x_{2}\right)(2H\left(R-\sqrt{(x_{1}-1)^{2}+(x_{2}+1)^{2}}\right)-1),$$

   where $H(x)$ is the Heaviside step function and for definiteness we choose $R=1$. In this case, the labels are flipped under both reflections along the $x_{1}=-x_{2}$ diagonal as well as the $x_{1}=x_{2}$ diagonal, which is why we shall refer to this case as fully anti-symmetric. As we will see later, it is straightforward to incorporate both symmetric and anti-symmetric properties in variational quantum circuits, while it is not obvious how to consider the anti-symmetric case in the classical neural networks.

3 Network Architectures

To assess the importance of embedding the symmetry in the network, and to compare the classical and quantum versions of the networks, we study the performance of the following four different architectures: (i) Deep Neural Network (DNN), (ii) Equivariant Neural Network (ENN), (iii) Quantum Neural Network (QNN), and (iv) Equivariant Quantum Neural Network (EQNN). In each case, we adjust the hyperparameters to ensure that the number of network parameters is roughly the same.

1. Deep Neural Networks:

   In our DNN, for the symmetric (anti-symmetric) case, we use one (two) hidden layer(s) with four neurons. For both types of classical networks, we use the softmax activation function, Adam optimizer, and a learning rate of $0.1$. We use the binary cross-entropy for both the DNN and ENN.

2. Equivariant Neural Networks:

   A given map $f:x\in X\to f(x)\in Y$ between an input space $X$ and an output space $Y$ is said to be equivariant under a group $G$ if it satisfies the following relation:

   $$f(g_{\text{in}}(x))=g_{\text{out}}(f(x)),$$ (7)

   where $g_{\text{in}}$ ($g_{\text{out}}$) is a representation of a group element $g\in G$ acting on the input (output) space. In the special case when $g_{\text{out}}$ is the trivial representation, the map is called invariant under the group $G$, i.e., a symmetry transformation acting on the input data $x$ does not change the output of the map. The goal of ENNs, or equivariant learning models in general, is to design a trainable map $f$ which would always satisfy Equation (7). In tasks where the symmetry is known, such equivariant models are believed to have an advantage in terms of the number of parameters and training complexity. Several studies in high-energy physics have attempted to use classical equivariant neural networks Bogatskiy et al. (2020, 2022); Hao et al. (2023); Buhmann et al. (2023); Batatia et al. (2023). Our ENN model utilizes four $\mathbb{Z}_{2}\times\mathbb{Z}_{2}$ symmetric copies for each data point, which are fed into the input layer, followed by one equivariant layer with three (two) neurons and one dense layer with four (four) neurons in the symmetric (anti-symmetric) case.

3. Quantum Neural Networks:

   For the QNN, we utilize the one-qubit data-reuploading model Pérez-Salinas et al. (2020), as shown in Fig. 4, with depth four (eight) for the symmetric (anti-symmetric and fully anti-symmetric) case, using the angle embedding and three parameters at each depth. This choice leads to a similar number of parameters as in the classical networks. We use the Adam optimizer and the loss

   $$L_{QNN}=y(1-|\mathinner{\langle{\psi}|}O_{1}\mathinner{|{\psi}\rangle}|)^{2}+(1-y)(1-|\mathinner{\langle{\psi}|}O_{2}\mathinner{|{\psi}\rangle}|)^{2}$$ψぷさい | end_ATOM italic_O start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT start_ATOM | italic_ψぷさい ⟩ end_ATOM | ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ( 1 - italic_y ) ( 1 - | start_ATOM ⟨ italic_ψぷさい | end_ATOM italic_O start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_ATOM | italic_ψぷさい ⟩ end_ATOM | ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT (8)

   for any choice of two orthogonal operators $O_{1}$ and $O_{2}$ (see Ref. Ahmed (2019) for more details.). In this paper, we use

   $$O_{1}=\begin{pmatrix}[r]1&0\\ 0&0\end{pmatrix},\quad\quad O_{2}=\begin{pmatrix}[r]0&0\\ 0&1\end{pmatrix}.$$ (9)

   for all three datasets considered in this paper.
   

   

   Figure 4: Illustration of the quantum circuit used for QNN at depth 2. This circuit is repeated up to depth four (five) times with different parameters for the symmetric (anti-symmetric and fully anti-symmetric) case. The data points $\vec{x}=(x_{1},x_{2},0)$ are loaded via angle embedding with rotation gates, followed by another rotation $R(\vec{x})=R_{Z}(0)R_{Y}(x_{2})R_{Z}(x_{1})$ with arbitrary angle parameters.

4. Equivariant Quantum Neural Networks.

   In EQNN models, symmetry transformations acting on the embedding space of input features are realized as finite-dimensional unitary transformations $U_{g}$, $g\in G$. Consider the simplest case where one trainable operator $U(\theta,x)$θしーた , italic_x ) acts on a state $\mathinner{|{\psi}\rangle}$ψぷさい ⟩: $U(\theta,x)\mathinner{|{\psi}\rangle}$θしーた , italic_x ) start_ATOM | italic_ψぷさい ⟩ end_ATOM. If for a symmetry transformation $U_{g}$, the condition

   $$U(\theta,x)\,U_{g}\mathinner{|{\psi}\rangle}=U_{g}\,U(\theta,x)\mathinner{|{\psi}\rangle},$$θしーた , italic_x ) italic_U start_POSTSUBSCRIPT italic_g end_POSTSUBSCRIPT start_ATOM | italic_ψぷさい ⟩ end_ATOM = italic_U start_POSTSUBSCRIPT italic_g end_POSTSUBSCRIPT italic_U ( italic_θしーた , italic_x ) start_ATOM | italic_ψぷさい ⟩ end_ATOM , (10)

   is satisfied, then the operator $U$ is equivariant, i.e., the equivariant gate should commute with the symmetry. In general, the $U_{g}$ operators on the two sides of Equation (10) do not necessarily have to be in the same representation but are often assumed so for simplicity. The output of a QNN is the measurement of the expectation value of the state with respect to some observable $O$. If the gates are equivariant and we apply some symmetry transformation $U_{g}$, then this is equivalent to measuring the observable $U_{g}^{\dagger}OU_{g}$. Hence, if $O$ commutes with the symmetry $U_{g}$, the model as a whole would be invariant under $U_{g}$, which is the case in our symmetric example. Otherwise the model is equivariant, as in our anti-symmetric example.

Our EQNN uses the two-qubit quantum circuit depicted in Figure 5 for depth 1. This circuit is repeated five (ten) times with different parameters for the symmetric (anti-symmetric and fully anti-symmetric). The two $R_{Z}$ gates embed $x_{1}$ and $x_{2}$, respectively. The $R_{X}$ gates share the same parameter ($\theta_{1}$θしーた start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT) and the $R_{ZZ}$ gate uses another parameter ($\theta_{2}$θしーた start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT). The invariant model (for the symmetric case) uses the same observable ${O}$ for both classes in the data. In the anti-symmetric case, we use two different observables ${O}_{1}$ and ${O}_{2}$ that correspond to each label. They transform into one another under reflection $g_{r}$, i.e., $U^{\dagger}_{g_{r}}{O}_{1}U_{g_{r}}={O}_{2}$.

Figure 5: Illustration of the quantum circuit used for EQNN at depth 1. This circuit is repeated five (ten) times with different parameters for the symmetric (anti-symmetric and fully anti-symmetric) case. The data points $(x_{1},x_{2})$ are loaded via angle embedding with two $R_{Z}$ gates, $R_{Z}(x_{1})$ and $R_{Z}(x_{2})$. The remaining circuits are parameterized by $R_{X}(\theta_{1})$θしーた start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT ) and $R_{Z}(\theta_{2})$θしーた start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT ).

In the symmetric case, we use binary cross-entropy loss, assuming the true label $y$ is either $0$ or $1$,

$$L_{EQNN}^{\rm symm}=y\log\Big{(}|\mathinner{\langle{\psi}|}O\mathinner{|{\psi}\rangle}|\Big{)}+(1-y)\log\Big{(}1-|\mathinner{\langle{\psi}|}O\mathinner{|{\psi}\rangle}|\Big{)}\,.$$ψぷさい | end_ATOM italic_O start_ATOM | italic_ψぷさい ⟩ end_ATOM | ) + ( 1 - italic_y ) roman_log ( 1 - | start_ATOM ⟨ italic_ψぷさい | end_ATOM italic_O start_ATOM | italic_ψぷさい ⟩ end_ATOM | ) . (11)

The observables $O$ and the reflection $U_{g_{r}}$ along $x_{1}=-x_{2}$ are defined as follows:

$$O=\dfrac{1}{4}\begin{pmatrix}1&1&1&1\\ 1&1&1&1\\ 1&1&1&1\\ 1&1&1&1\end{pmatrix},\quad\quad U_{g_{r}}=\begin{pmatrix}0&0&0&1\\ 0&0&1&0\\ 0&1&0&0\\ 1&0&0&0\end{pmatrix}.$$ (12)

In the anti-symmetric and fully anti-symmetric cases, we used the same loss as in QNN

$$L_{EQNN}^{\rm anti-symm}=y(1-|\mathinner{\langle{\psi}|}O_{1}\mathinner{|{\psi}\rangle}|)^{2}+(1-y)(1-|\mathinner{\langle{\psi}|}O_{2}\mathinner{|{\psi}\rangle}|)^{2}\,.$$ψぷさい | end_ATOM italic_O start_POSTSUBSCRIPT 1 end_POSTSUBSCRIPT start_ATOM | italic_ψぷさい ⟩ end_ATOM | ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT + ( 1 - italic_y ) ( 1 - | start_ATOM ⟨ italic_ψぷさい | end_ATOM italic_O start_POSTSUBSCRIPT 2 end_POSTSUBSCRIPT start_ATOM | italic_ψぷさい ⟩ end_ATOM | ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT . (13)

For the anti-symmetric case $O_{1}$ ($O_{2}$) is the observable corresponding to $y=1$ ($y=0$)

$$O_{1}=\dfrac{1}{4}\begin{pmatrix}[r]1&1&1&-1\\ 1&1&1&-1\\ 1&1&1&-1\\ -1&-1&-1&1\end{pmatrix},\quad\quad O_{2}=\dfrac{1}{4}\begin{pmatrix}[r]1&-1&-1&-1\\ -1&1&1&1\\ -1&1&1&1\\ -1&1&1&1\end{pmatrix}.$$ (14)

For the fully anti-symmetric case, we use another set of observables, so one will transform into the other with reflection along any of the two diagonals. They are given as follows:

$$O_{1}=\dfrac{1}{4}\begin{pmatrix}[r]1&-1&1&1\\ -1&1&-1&1\\ 1&-1&1&-1\\ 1&1&-1&1\end{pmatrix},\quad\quad O_{2}=\dfrac{1}{4}\begin{pmatrix}[r]1&1&-1&1\\ 1&1&-1&-1\\ -1&-1&1&1\\ 1&-1&1&1\end{pmatrix}.$$ (15)

Since it is anti-symmetric with respect to each of the diagonals, the result is invariant if both reflections are applied. It is difficult to build a classical equivariant neural network using these anti-symmetries since classical equivariant models are built based on the assumption that the target is invariant under certain transformations. When discussing the theory of classical equivariant machine learning models, the models that transform non-trivially under the symmetry group are often discussed mathematically but rarely implemented in code. For our classical model on partially anti-symmetric data, we only implemented the invariant part of the symmetry ($\mathbb{Z}_{2}$) and ignored the anti-symmetric portion of the data. While it may not be impossible to consider such asymmetric cases in classical neural networks, implementation can be quite involved.

On the other hand, it is straightforward to build quantum equivariant models. For this purpose, we would only need to exploit the transformation properties of the observables. If one observable transforms to the other under the transformation of interest (reflection along the diagonal in this case), then measurement made on one observable is equivalent to the measurement of the other observable given the transformed input.

We can consider equivariant quantum models with anti-symmetric transformation from the point of view of representation theory. The fully invariant (symmetric) case can be considered as the model transform under the trivial representation of the group, where all the transformations defined by the group do not change the output of the model. The asymmetric (either anti-symmetric or fully anti-symmetric) cases that we considered here can be interpreted as transforms under some other (one-dimensional) representation of the group, where some transformations change the output of the model to its opposite value, while other transformations do not change the output.

4 Results

The left panels in Figure 6 show the receiver operating characteristic (ROC) curves for each network with $N_{\rm train}=200$ and $N_{\rm test}=2000$ samples for the symmetric (top), anti-symmetric (middle), and fully anti-symmetric (bottom) dataset. The results for the DNN, ENN, QNN, and EQNN are shown in (green, dotted), (yellow, dotdashed), (red, dashed), and (blue, solid), respectively. As expected, networks with an equivariance structure (EQNN and ENN) improve the performance of the corresponding networks (QNN and DNN) without the symmetry. We also observe that quantum networks perform better than the classical analogs. In the legends, numerical values followed by network acronyms represent the number of parameters used for each network. For the symmetric example, the EQNN uses only 10 parameters; thus, for fair comparison, we constructed the other networks with ${\cal O}$(10) parameters as well. For the anti-symmetric example, we use 20 parameters for the EQNN.

Figure 6: ROC (left) and accuracy (right) curves for the symmetric (top), anti-symmetric (middle), and fully anti-symmetric (bottom) example.

The evolution of the accuracy during training and testing is shown in the right panels of Figure 6. The accuracy converges faster (after only 5 epochs) for the QNN and EQNN in comparison to their classical counterparts (10–20 epochs). The same color-scheme is used, but this time, solid curves represent training accuracy, while dashed curves show test accuracy.

To further quantify the performance of our quantum networks, in Figure 7, we show the AUC (Area under the ROC Curve) as a function of the number of parameters (left panels) with a fixed size of the training data ($N_{\rm train}=200$), and as a function of the number of training samples (right panels) with a fixed number of parameters ($N_{\rm params}=20$). The top, middle, and bottom panels show results for the symmetric, anti-symmetric, and fully anti-symmetric dataset. As the number of parameters increases, the performance of all networks improves. All AUえーゆーC values become similar when $N_{\rm params}\approx 20$ ($N_{\rm params}\approx 40$) for the symmetric (anti-symmetric) case. As shown in the bottom panels, the performances of all networks become comparable to each other for both examples once the size of the training data reaches $\sim$400, except for the fully anti-symmetric case. We observe that from the top panel to the bottom panel, the relative improvement from the QNN to the EQNN grows, indicating the importance of symmetry implementation on the network. Similar relative improvement exists from the DNN to the QNN, emphasizing the importance of quantum algorithms. Note that the ENN curves are missing in the bottom panel of both Figures 6 and 7. This is due to the non-trivial implementation of the anti-symmetric property in classical ENNs.

Figure 7: AUC as a function of the number of parameters (left) for fixed $N_{\rm train}=2000$ and $N_{\rm test}=200$, and as a function of $N_{\rm train}$ (right) with a fixed number of parameters as shown in the legend, for the symmetric (top), anti-symmetric (middle), and fully anti-symmetric example (bottom).

Finally Table 1 shows the accuracy of the DNN for the fully anti-symmetric dataset. The different rows and columns represent different choices of the number of parameters and the number of training samples, respectively. These numbers are compared against those in right-bottom panel of Figure 7. The EQNN achieves 0.95 accuracy with 20 parameters and 200 training samples, while the DNN requires more parameters and/or more training samples.

Table 1: Accuracy of DNN for the fully anti-symmetric dataset. The different rows (columns) represent different choices of the number of parameters (the number of training samples).

$N_{\rm params}$\$N_{\rm train}$	100	200	300	400	500	600	700	800	900
105	0.764	0.855	0.879	0.963	0.973	0.981	0.981	0.982	0.988
85	0.669	0.743	0.804	0.953	0.951	0.978	0.986	0.946	0.981
67	0.587	0.722	0.695	0.946	0.886	0.9632	0.975	0.944	0.980
51	0.624	0.655	0.856	0.926	0.908	0.876	0.846	0.974	0.986
37	0.596	0.696	0.639	0.782	0.747	0.816	0.849	0.922	0.952

5 Conclusions

In this paper, we examined the performance of Equivariant Quantum Neural Networks and Quantum Neural Networks, compared against their classical counterparts, Equivariant Neural Networks and Deep Neural Networks, considering two toy examples for a binary classification task. Our study demonstrates that EQNNs and QNNs outperform their classical counterparts, particularly in scenarios with fewer parameters and smaller training datasets. This highlights the potential of quantum-inspired architectures in resource-constrained settings. This point has been emphasized in a similar study recently in Ref. Chang et al. (2023), which showed that an EQNN outperforms the non-equivariant one in terms of generalization power, especially with a small training set size. We note a more significant enhancement in the performance of an EQNN and QNN compared to an ENN and DNN, particularly evident in the anti-symmetric example rather than the symmetric one. This underscores the robustness of quantum algorithms. The code used for this study is publicly available at https://github.com/ZhongtianD/EQNN/tree/main (accessed on 9 March 2024).

While our current study has primarily focused on an EQNN with discrete symmetries, it is crucial to acknowledge the significant role that continuous symmetries, such as Lorentz symmetry or gauge symmetries, play in particle physics. In our future research, we aim to compare an EQNN with continuous symmetries against classical neural networks. Exploring more complex datasets with high-dimensional features is another direction we plan to pursue. However, handling such examples would necessitate an increase in the number of network parameters, prompting an investigation into related issues like overparameterization, barren plateaus, and others.

Conceptualization, Z.D.; methodology, M.C.C., G.R.D., Z.D., R.T.F., S.G., D.J., K.K., T.M., K.T.M., K.M., and E.B.U.; software, Z.D.; validation, M.C.C., G.R.D., Z.D., R.T.F., T.M., and E.B.U.; formal analysis, Z.D.; investigation, M.C.C., G.R.D., Z.D., R.T.F., T.M., and E.B.U.; resources, Z.D., K.T.M., and K.M.; data curation, G.R.D., S.G., and T.M.; writing—original draft preparation, Z.D.; writing—review and editing, S.G., D.J., K.K., K.T.M., and K.M.; visualization, Z.D.; supervision, S.G., D.J., K.K., K.T.M., and K.M.; project administration, S.G., D.J., K.K., K.T.M., and K.M.; funding acquisition, S.G. All authors have read and agreed to the published version of the manuscript.

This research used resources of the National Energy Research Scientific Computing Center, a DOE Office of Science User Facility supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC02-05CH11231 using NERSC award NERSC DDR-ERCAP0025759. SG is supported in part by the U.S. Department of Energy (DOE) under Award No. DE-SC0012447. KM is supported in part by the U.S. Department of Energy award number DE-SC0022148. KK is supported in part by the US DOE DE-SC0024407. CD is supported in part by the College of Liberal Arts and Sciences Research Fund at the University of Kansas. CD, RF, EU, MCC, and TM were participants in the 2023 Google Summer of Code.

Not applicable.

The dataset used in this analysis was sampled from Equations (1), (4) and (6).

The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

Abbreviations The following abbreviations are used in this manuscript:

API	Application Processing Interface
AUC	Area Under the Curve
DNN	Deep Neural Network
ENN	Equivariant Neural Network
EQNN	Equivariant Quantum Neural Network
HEP	High-Energy Physics
LHC	Large Hadron Collider
MDPI	Multidisciplinary Digital Publishing Institute
ML	Machine Learning
NN	Neural Network
QML	Quantum Machine Learning
QNN	Quantum Neural Network
ROC	Receiver Operating Characteristic

References