A memristor array has emerged as a potential computing hardware for artificial intelligence (AI). It has an inherent memory effect that allows information storage in the form of easily programmable electrical conductance, making it suitable for efficient data processing without shuttling of data between the processor and memory. To realize its full potential for AI applications, fine-tuning of internal device dynamics is required to implement a network system that employs dynamic functions. Here, we provide a perspective on multicationic entropy-stabilized oxides as a widely tunable materials system for memristor applications. We highlight the potential for efficient data processing in machine learning tasks enabled by the implementation of “task specific” neural networks that derive from this material tunability.

Energy consumption by computation has grown exponentially following the growth of artificial intelligence (AI) and machine learning (ML) technologies.1 In AI/ML applications, hardware systems have been forced to store and process large quantities of data. In conventional computers based on the Von Neumann architecture, where memory and processing units are segregated, data move between the two segregated components via a data bus. This shuttling of data causes severe latency and energy consumption issues.2–4 The problem is compounded as the amount and frequency of data shuttled back and forth increases, leading to a state where the system speed is bounded, not by computing capability (compute-bound), but by the data movement (memory-bound)—the so-called memory bottleneck.2–5 

A recent approach for accelerated AI/ML tasks is achieving a reduced data path. Thus, recent computing fabrics have portioned some processing units near or into memory units.6–17 For example, compute-in-memory (CIM) technologies have successfully achieved an acceleration with crossbar arrays of memory technologies, such as static random access memory (SRAM) and dynamic RAM (DRAM).18 In parallel, CIM technologies have expanded to include emerging memories such as resistive RAM (RRAM),19 phase change memory (PCM),20 spin-transfer torque magnetic RAM (STT-MRAM),12,21 and the ferroelectric field effect transistor (FeFET).22 In the memristor array, voltage inputs applied to rows of the array (vector) is natively multiplied with information stored in the conductance (matrix) of the array nodes by simple Ohm's law. The resultant currents are gathered at the columns of the array following Kirchhoff's current law [multiplicate-accumulate (MAC)]. The simple structure and the nature of memristors jointly execute vector-matrix multiplication (VMM) much faster and with far greater energy efficiency (∼pJ per MAC operation) than conventional computers (∼nJ) by bypassing retrieval of data from the segregated memory to the processing units. The performance enhancements can support intensive ML-based computing.23–28 

Further acceleration has been explored in the analog domain utilizing multi-bit precision of analog memristors. The approach reduces the amount of data to be handled in a digitized manner, leading to shorter latency, bypassing bitwise processing.38–40 Multiple memory technologies have been developed and adopted, depending on the application, in order to optimize the strengths and weaknesses of each (e.g., high programming power and lack of symmetric conductance for PCM, low on/off ratio, and lack of multi-bit storage for STT-MRAM).41,42 A summary of the technologies is presented in Table I. The acceleration achieved in the analog domain, however, is degraded by arithmetic or logical operations other than MAC operations in computing systems.43,44 Arithmetic logic units (ALUs) that were originally designed to work in the digital domain enforce intermediate analog outputs from the analog MAC operation to be converted into digital values by analog–digital converters (ADCs). The ADCs burden the system and diminish the benefits of analog MAC.45–47 The performance degradation is compounded when analog acceleration techniques require analog inputs, as the digital values from the ALUs will be again converted back into analog by digital–analog converters (DACs).

TABLE I.

Comparison of emerging memory devices. Information is gathered from the IRDS 2023 and Refs. 29–37.

RRAM PCM STT-MRAM FeFET ECRAM
Material  HfOx, TaOx, TiOx  GeSb, GeTe, Sb2Te3 FeCo, CoFeB-MgO  HfO2, AlScN, PbTiO3  LixTiO2, WOx 
Switching speed  100 ps  50 ns  10–20 ns  5 ns  0.01 s 
Bit-precision  16  >250 
On/off ratio  102  106  6.3 (TMR ratio)  106  107 
Retention (@ RT)  > 10 yrs  >10 yrs  >10 yrs  ∼17 days  >104 s 
Energy for training  0.57 pJ  3 V, 200 μ 120 fJ  3 fJ  ∼1 fJ 
Energy for inference (read current/read voltage)  10 μA–77 nA/0.1 V  <3 V,  20 μA/0.24 V  ∼40 μA/μ 0.3 V 
0.1 V 
Endurance  >1012  109  1012  1012  >106 
Area  4F2  16 F2  40 F2  4F2 NAND   
Feature size (F)  3 nm  sub-20 nm  22 nm  22 nm   
BEOL compatibility  Demonstrated  Demonstrated  Demonstrated  Demonstrated   
RRAM PCM STT-MRAM FeFET ECRAM
Material  HfOx, TaOx, TiOx  GeSb, GeTe, Sb2Te3 FeCo, CoFeB-MgO  HfO2, AlScN, PbTiO3  LixTiO2, WOx 
Switching speed  100 ps  50 ns  10–20 ns  5 ns  0.01 s 
Bit-precision  16  >250 
On/off ratio  102  106  6.3 (TMR ratio)  106  107 
Retention (@ RT)  > 10 yrs  >10 yrs  >10 yrs  ∼17 days  >104 s 
Energy for training  0.57 pJ  3 V, 200 μ 120 fJ  3 fJ  ∼1 fJ 
Energy for inference (read current/read voltage)  10 μA–77 nA/0.1 V  <3 V,  20 μA/0.24 V  ∼40 μA/μ 0.3 V 
0.1 V 
Endurance  >1012  109  1012  1012  >106 
Area  4F2  16 F2  40 F2  4F2 NAND   
Feature size (F)  3 nm  sub-20 nm  22 nm  22 nm   
BEOL compatibility  Demonstrated  Demonstrated  Demonstrated  Demonstrated   

RRAM can play a critical role in minimizing the conversion deficiencies by executing operations beyond MAC in the analog domain.48 In conventional filament-based RRAM, atoms or vacancies are moved within these materials to create or terminate conductive filaments, resulting in the modulation of electrical conductance. The conductance characteristics can natively adapt a variety of analog functionalities in their natural response to analog inputs.49–53 It can not only resolve the issue by eliminating the necessity of conversions, but also improve expressivity that may have been compromised by digital computers. For instance, non-linear activation functions have been developed and adopted by AI/ML models to infuse non-linear neuronal or synaptic behavior.54–57 The conventional digital computer that is great at binary and linear mathematical operations, such as addition and multiplication, indirectly executes the non-linear functions utilizing approximation such as Taylor series and lookup tables (LUTs) due to the lack of non-linearity.58,59 However, filamentary RRAM can naturally demonstrates non-linearity in a very power-efficient manner.49–53 

In amorphous switching medium-based memristors, however, the resistive switching (RS) and the non-linear dynamics rely on the stochastic movement of oxygen vacancies, causing intrinsic limits on reliability and controllability of device properties. Further, today's AI models demand different hardware requirements depending on their operation. Thus, large AI models whose size is too big to be mapped at once are more vulnerable to reliability errors and require memories that consume less energy for write operations due to inevitable repetition of mapping a partial model (matrices) on crossbar arrays.60–63 On the other hand, a longer retention and less energy for read operations are more desirable for models that can be mapped on a computing hardware at once, because the computing systems can keep reusing the full model parameters once they are mapped. However, those properties are fundamentally coupled in the memristors in that the higher energy barrier for oxygen vacancy migration enhances the memory retention while increasing energy consumption for programming, and vice versa. Furthermore, analog computing systems demands higher reliability, high ON-OFF ratio, and multiple conductance states to ensure that a sufficient number of bits can be mapped onto a single device.64–66 In the case of non-linear functions that are usually adopted on all hierarchies in neural networks and executed per inference, much higher criteria for cycle-to-cycle variation (C2C, reliability) are required to execute tasks as desired. In addition to reliability, the performance of neural networks largely depends on the optimized non-linear functions.67 Thus, the ability to tune the various tradeoffs is critical to properly design hardware for neural networks.

These requirements are difficult to achieve in the amorphous filamentary-based memristors that are characterized by abrupt changes in resistance upon switching. A fundamental approach is required to engineer the physical dynamics of the switching medium to mitigate variability in devices (Fig. 1).

FIG. 1.

Comparison between conventional oxide memristors and entropy-stabilized oxide (ESO) memristors. (Left) Resistive switching (RS) dynamics of conventional (amorphous) oxide memristors rely on the local movement of oxygen vacancies that leads to the formation of a conductive filament. (Right) The RS dynamics of ESO [(MgCoNiCuZn)O] memristors is mediated by localized charge as a result of point defect formation that can be tuned by the alloy composition. Better control of device properties, such as enhanced reliability and predictability, can be achieved. Trapped electrons are illustrated for the ESO memristor.

FIG. 1.

Comparison between conventional oxide memristors and entropy-stabilized oxide (ESO) memristors. (Left) Resistive switching (RS) dynamics of conventional (amorphous) oxide memristors rely on the local movement of oxygen vacancies that leads to the formation of a conductive filament. (Right) The RS dynamics of ESO [(MgCoNiCuZn)O] memristors is mediated by localized charge as a result of point defect formation that can be tuned by the alloy composition. Better control of device properties, such as enhanced reliability and predictability, can be achieved. Trapped electrons are illustrated for the ESO memristor.

Close modal

Entropy-stabilized oxides (ESOs) are emerging materials in ceramics. ESOs are a solid solution of more than five different cations, differentiated by high-entropy oxides (HEOs) in that they are stabilized in a single phase by a configuration entropy that overcomes an enthalpy penalty (Fig. 2).68,69 The initial report of a rock salt (MgNiCoCuZn)O ESO in 2019 by Rost and colleagues68 has since spurred a wide range of research in the broader area of high (configurational) entropy oxides.70–73 

FIG. 2.

The probability of a local configuration in entropy-stabilized oxides with varied composition as compared with an ideal rock salt. The ideal rock salt (binary) will have one microstate, i.e., oxygen octahedrally coordinated by the same cation with all bond lengths and angles the same (colored with cyan). The ESO with a composition consisting of five distinct cation species leads to 210 possible microstates when only considering site occupancy on an ideal lattice (i.e., the number of combinations that five distinct cations can occupy the six nearest neighbor sites of oxygen). The probability distribution of possible microstates can be reasonably fit to a Gaussian function. Some examples of microstates are depicted by the local structures of oxygen that are octahedrally coordinated by different combinations of cations where five different colors represent different cation species. Tuning of cation composition can change the probability for each microstate to occur, e.g., increasing the composition of cation A (xA) from 0.1 to 0.3 (while the other four cations equally compose the remaining mole fraction) increases the probability of A-rich microstates. An ESO with equimolar composition shows the maximum variance of distribution (which can also be related to the maximized configurational entropy).

FIG. 2.

The probability of a local configuration in entropy-stabilized oxides with varied composition as compared with an ideal rock salt. The ideal rock salt (binary) will have one microstate, i.e., oxygen octahedrally coordinated by the same cation with all bond lengths and angles the same (colored with cyan). The ESO with a composition consisting of five distinct cation species leads to 210 possible microstates when only considering site occupancy on an ideal lattice (i.e., the number of combinations that five distinct cations can occupy the six nearest neighbor sites of oxygen). The probability distribution of possible microstates can be reasonably fit to a Gaussian function. Some examples of microstates are depicted by the local structures of oxygen that are octahedrally coordinated by different combinations of cations where five different colors represent different cation species. Tuning of cation composition can change the probability for each microstate to occur, e.g., increasing the composition of cation A (xA) from 0.1 to 0.3 (while the other four cations equally compose the remaining mole fraction) increases the probability of A-rich microstates. An ESO with equimolar composition shows the maximum variance of distribution (which can also be related to the maximized configurational entropy).

Close modal

Regarding material properties that may be harnessed for memristor phenomena, the homogeneous dispersion of cations suggests uniform properties (as long as the measurement length scale is longer than any correlation or coherence length—note that about the second nearest neighbor distance is where bond lengths begin to appear uniform)74 reducing the expected device to device variation. Further, the cation composition can be continuously tuned over a large range and facilitates the continuous control of macroscopic physical properties. In cases, the properties can be dominated by local configurations where cation size differences and coordination preferences lead to local structural disorder and stereochemical configurations. While these features are exciting for materials design, it is the latter that may provide a pathway to new or rare phenomena (Fig. 2). It is in these features that we will discuss recent findings on the interplay between composition, local disorder and strain, intrinsic point defect formation, and the associated electronic structure. Building upon these leads to exciting opportunities for memristor behavior that can be harnessed for efficient computing.

As a homogeneous solid solution, the homogeneous multicationic sublattice leads to local structural disorder due to differing cation size and stereochemistry.70,74–76 While a rock salt binary oxide is characterized by a single type of bond length and bond angle, rock salt (MgNiCoCuZn)O accommodates a broad range of local configurations even when only considering site occupancy on an ideal rock salt structure (Fig. 2). Naturally, the true local structure that has local structural distortions broadens this histogram. The probability of a local configuration and associated structural distortion can be tuned by the cationic composition (Fig. 2). For example, Cu-rich ESOs have the most structural distortion due to the Jahn–Teller distortion, and the opposite is for Mg-rich composition as MgO is the most stable in rock salt with the lattice parameter closest to the ESO among the other constituent elements.74,76–78 As the local stress induced by Cu2+ ions can be accommodated by the formation of vacancies in the nearby lattice, single-phase ESO can be commensurate with the formation of a high density native vacancies; otherwise, multi-phases form via phase segregation.79 

The tunable local structural distortion can be applied to engineer the formation of vacancy defects in the ESO. Employing DFT, Chae et al. discovered the fundamental principles that govern the cation and anion vacancy formation energies in the ESO.80 To capture the effect of the local configuration, the ESO structure was modeled by a 80-atoms supercell of a special quasi-random structure (SQS), and vacancy formation energies are calculated for oxygens with 40 different local coordinations.80 In the case of a cation vacancy, the formation energy decreases with increasing the average local tensile strain of bonds relative to the binary oxides (ϵBOrel), which can be estimated from how much the lattice parameter of ESO (aESO) deviates from that of component binary oxides (ab) [Fig. 3(a)],
where di,ESO is the local cation-oxygen bond length in the ESO and db is the cation-oxygen bond length in the corresponding rock salt binary oxide. Note that the cation vacancy formation energies do not correspond to the average local strain relative to the bulk ESO (ϵESOrel) defined as
where dESO is the average cation-oxygen bond length in the ESO (i.e., 12aESO) [Fig. 3(b)]. In (MgNiCoCuZn)O, the formation energy of the Cu vacancy is lowest as CuO has the lattice parameter that deviates the most from the ESO and in a way that causes the most local tensile strain.
FIG. 3.

The effect of local configuration on vacancy formation in rock salt (MgNiCoCuZn)O. The formation energies of cation vacancies in the rock salt (MgNiCoCuZn)O ESO decrease with increasing local strain relative to the binary oxides (a), and does not correlate with local strain relative to the average ESO bond lengths (b). (c) The formation energies of oxygen vacancies in the ESO depend on the first-nearest-neighbor (1NN) shell composition represented by the color bar in each column. (d) The vacancy concentration of oxygen and cations is calculated as a function of Cu mole fraction. (e) The histogram of oxygen vacancy formation energies for all 210 possible combinations of the first-nearest neighbor shell. The inset shows the histogram for formation energies that are negative (red box). Figures are adapted from Ref. 80.

FIG. 3.

The effect of local configuration on vacancy formation in rock salt (MgNiCoCuZn)O. The formation energies of cation vacancies in the rock salt (MgNiCoCuZn)O ESO decrease with increasing local strain relative to the binary oxides (a), and does not correlate with local strain relative to the average ESO bond lengths (b). (c) The formation energies of oxygen vacancies in the ESO depend on the first-nearest-neighbor (1NN) shell composition represented by the color bar in each column. (d) The vacancy concentration of oxygen and cations is calculated as a function of Cu mole fraction. (e) The histogram of oxygen vacancy formation energies for all 210 possible combinations of the first-nearest neighbor shell. The inset shows the histogram for formation energies that are negative (red box). Figures are adapted from Ref. 80.

Close modal

On the other sublattice, the structural distortion at an oxygen site is dependent upon the local nearest neighbor cation configuration, as the different combination of cations in the nearest neighbor leads to different local bond configurations [Fig. 3(c)]. As Cu (Mg) causes the most (least) structural distortion, oxygen vacancies are the most (least) likely to form in Cu (Mg)-rich local sites within the ESO. This allows control of vacancy concentration via the alloy composition [Fig. 3(d)]. One strategy to building the defect formation energy from an element-by-element contribution involves a linear regression analysis of DFT computed formation energies over the number of each cation in the nearest neighbor coordination shell.81 Using the linear regression model, the formation energies of VOs for the 210 possible combinations of the 1NN shell are calculated, notated by ELRfVO. The distribution of ELRf(VO) is plotted in Fig. 3(e), showing a large variation of vacancy formation energies (from −0.8 to 2.4 eV) resulting from the local configuration. The presence of negative vacancy formation energies indicates the spontaneous formation of VO in Cu-rich local configurations [the inset in Fig. 3(e)]. This not only explains that ESO natively have a large density of VOs (∼1021 cm−3 in bulk, equimolar composition) but is a clear example of a case where a physical phenomenon is dominated by the rare local configurations located at the tail of the local microstructure histogram (e.g., NCu > 3).

Another unique physical feature of defect formation in ESOs is that the charges from VO can be accommodated by the shift of cation valence. Kotsonis et al.81 observed that the valence control of Co upon deposition temperature is attributed to the formation of cation vacancies, showing that Co is tolerant to multivalency (+2 and +3) in the ESO. The valence control of Co further allows tunability of magnetic disorder as Co2+/Co3+ has high/low spin state.76 

Defect formation in ESO accompanies a charge transition where the charge state of defects depends on the Fermi energy and the equilibrium Fermi energy is determined by the interplay of charged defects. In rock salt (MgNiCoCuZn)O, VO is a deep donor with ionization energy of 1.24 eV, while VCu (a dominant cation vacancy) is a deep acceptor with ionization energy of 0.658 eV. The interplay between VO and Vcations pins the Fermi energy at a deep energy level within the bandgap, which explains electrically insulating behavior of ESOs.80 Instead, the conduction of ESO is dominated by the hopping conduction of trapped electrons through randomly distributed localized electronic trap states created by vacancy defects.82,83 Jacobson et al. related the conductivity of the ESO to the oxygen stoichiometry, which shifts the oxidation state of Co and suggests the hopping conduction of ESO is mediated by the charge transfer of Co.82 

Combining these observations with prior theory results would imply that hopping barrier and hopping distance can be systematically tuned with the composition of the ESO. However, the transport studies have been focused on bulk samples (polycrystals) and thin films with top-electrodes only as single-crystalline ESO thin films had only been grown on insulating MgO substrates (for the case of the parent composition [(MgNiCoCuZn)O]). To fabricate single-crystalline ESO thin films in metal-insulator-metal (MIM) structure, an epitaxial bottom layer of conducting materials needs to be inserted. Candidate materials are pure metals that can be epitaxially grown on MgO substrates such as Fe or Ge; however, challenges arise from their oxidation during the integration process. Other candidates are conducting oxides, and among them, YBa2Cu3O7–x (YBCO) is identified to work as a bottom electrode for the ESO. Yoo et al. employed YBCO bottom electrodes and fabricated single-crystalline ESO memristors. Despite the large lattice misfit between in-plane lattice parameters of ESO and YBCO (10.7% and 8.86% along the a and b directions, respectively), x-ray diffraction shows a strong 002 peak in the symmetric scan as well as ESO 022 and YBCO 026 peaks in the asymmetric scan, verifying in-plane epitaxial relationship of [100]ESOǁ[100]YBCO.

Frequency-dependent conductivity measurements of Mg-varied single crystalline ESO thin films show agreement with the correlated barrier hopping (CBH) model where the hopping barrier of the ESO can be obtained from the slope of measured ac conductivity as a function of frequency. The hopping barrier decreases for Mg-poor (vacancy-rich) samples, which can be explained by the shift of vacancy level as a function of local cation configurations. The tunable defect formation and energy level enables design of properties of devices that comprise ESOs.

The tunability leads to controllable resistive switching (RS) of the ESO-based memristors. The tunable RS dynamics was demonstrated by Yoo et al.67 This work reported (MgNiCoCuZn)O ESO memristors where the RS mechanism is based on trapping/detrapping electrons in defects [Fig. 4(a)]. The major defects in the ESO are oxygen vacancies, which have mid-gap energy levels. Those defects are normally filled, resulting in a high resistive state (HRS). At high applied voltage, electrons trapped in the defect levels escape from the traps, and these empty traps can facilitate hopping conduction of injected electrons, leading to low resistance state (LRS). After the bias is removed, it takes finite time (τ) to refill the traps.67 As the traps are being filled, the number of hopping sites reduces, increasing the average hopping distances (R¯nm) and exponential decay of hopping conductivity [ σexp(R¯nm)].84 

FIG. 4.

ESO memristors with tunable device properties. (a) Schematic of the changes in the number of hopping sites during and after an electrical input. Conductance modulation range (b) and decay time constant (c) of ESO memristors with varied Mg composition. (d) Conductance modulation caused by different input streams. Figures are adapted from Ref. 67.

FIG. 4.

ESO memristors with tunable device properties. (a) Schematic of the changes in the number of hopping sites during and after an electrical input. Conductance modulation range (b) and decay time constant (c) of ESO memristors with varied Mg composition. (d) Conductance modulation caused by different input streams. Figures are adapted from Ref. 67.

Close modal

The conductance dependence on the number of hopping sites is illustrated by an experiment where four consecutive pulses are applied to a memristor and the corresponding conductance modulation range is derived [Fig. 4(b)]. It displays that the smaller range of hopping sites (proportional to the number of oxygen vacancy) leads to the narrower conductance range. Despite the ability to modulate intrinsic device parameters, electron-based RS mechanism leads to a short-term memory effect. The volatility makes the (MgNiCoCuZn)O ESO-based memristor inappropriate as a nonvolatile memory (NVM) for CIM architecture-based hardware. However, the volatility presents a different opportunity for neural network hardware.

During the short retention period, the ESO memristors show non-linear behavior in their conductance. The non-linearity is measured by monitoring the conductance after the removal of the electrical bias and is well described by the stretched exponential function (SEF) that is commonly used to describe electronic and structural relaxation in disordered material systems85–87 [Fig. 4(c)]. The relaxation process in a disordered system involves a wide range of relaxation times and activation energies, and SEF describes the collective behavior of different relaxation processes. It is described by
(1)
where G(t) is the conductance, G0 is the conductance just after programming, τ is the characteristic relaxation time, and β is the stretch index representing degree of disorder in the system.49 The advantage of ESO memristors is that the internal dynamics can be systematically tunable by defect engineering using alloy composition, resulting in finely tunable τ: Increasing Mg composition leads to a higher energy barrier of hopping, which prevents trapped electrons from escaping and leads to shorter τ. It is also possible to tune β by tuning the structural disorder of the ESO.

Leveraging the compositionally tunable τ and conductance modulation range, ESO memristors with different cation compositions can uniquely respond to the various combinations of pulses (1/0 represents the existence/absence of a pulse) [Fig. 4(d)]. It indicates that the ESO enables systematic design of devices that can process information in a way harnessing the compositional tuning of the dynamical conductance. In addition to the dynamics (characterized by τ and β), the experiment demonstrates tunability of a range of device parameters in ESO memristors, such as leakage current, conductance at the low resistance states, or impedance.67 In addition to the controllability, the high endurance of the ESO memristor (>106 cycles) makes the memristor more eligible for neural network applications.67 

The ability to fine tune the non-linear response is crucial for the applicability of memristors. One example is presented in Ref. 88. As an algorithmic framework, RRAM with the exponential conductance decay in time can efficiently work with an event-based camera with neuromorphic vision sensors.88 It produces an event (spike) whenever the intensity of pixels in the frame changes above a threshold.89 

In the work, each RRAM is proposed to be dedicated to a pixel and receive spikes as produced [Fig. 5(a)]. The RRAMs encode the temporal information hidden in the spikes following their native exponential decay [Fig. 5(b)]. The behavior upon temporal inputs gives neural networks temporal information that can easily be dismissed by conventional encoding methods, such as a simple accumulation of spikes.90 The proper controllability of the characteristics is essential for the optimal performance of the network, because different hierarchies in the network leveraging the RRAM demand different relaxation time constants to process temporal information at different timescales. Figure 5(c) presents the performance-cost comparison of the network to others on a neuromorphic vision task, indicating the RRAM realizes a better and lighter network.

FIG. 5.

Task-driven system design underpinning non-linearity of RRAMs. (a) Dynamic RRAMs receiving spikes from their dedicated pixels. The right panel presents the RRAMs non-linear response to the incoming spikes with time. (b) Illustration of spikes from an event-based camera processed by RRAMs. Individual RRAMs encode temporal information leveraging the non-linear response. (c) Comparison of performance-cost (accuracy-the number of parameters) of network leveraging the dynamic RRAMs to other networks on CIFAR10-DVS task. (b) and (c) Adapted from Ref. 88. (d) An example of data (spectrogram) in the speech recognition task. The inset displays four consecutive pulses of a channel with a time interval (tinterval). (e) Accuracy of composition-varied ESO memristors on inputs with three different tinterval. (d) and (e) Adapted from Ref. 67.

FIG. 5.

Task-driven system design underpinning non-linearity of RRAMs. (a) Dynamic RRAMs receiving spikes from their dedicated pixels. The right panel presents the RRAMs non-linear response to the incoming spikes with time. (b) Illustration of spikes from an event-based camera processed by RRAMs. Individual RRAMs encode temporal information leveraging the non-linear response. (c) Comparison of performance-cost (accuracy-the number of parameters) of network leveraging the dynamic RRAMs to other networks on CIFAR10-DVS task. (b) and (c) Adapted from Ref. 88. (d) An example of data (spectrogram) in the speech recognition task. The inset displays four consecutive pulses of a channel with a time interval (tinterval). (e) Accuracy of composition-varied ESO memristors on inputs with three different tinterval. (d) and (e) Adapted from Ref. 67.

Close modal

The fine tunability of device dynamics discussed in Secs. II C–IV makes ESO an excellent candidate for task-specific neural networks, such as the aforementioned example,88 which has remained challenging in traditional amorphous oxides-based memristors. As a physical demonstration of a dynamic-based neural network, the reservoir computing (RC) network was implemented with ESOs and performed spoken-digit recognition task [Fig. 5(d)].67 

RC systems process data that are not easily separable in its original feature space and instead use non-linear functions to map them into a high-dimensional computational space (i.e., the reservoir state) where they become easily separable.91,92 The demonstration showed that the ESO can offer optimal non-linear functions depending on the timescale of tasks (all identical except for the time resolution—100, 250, and 450 ns, respectively) [Fig. 5(e)]. It confirms that the fine tunability of non-linear function is of high significance for task-specific AI hardware.

The ESO memristor also demonstrates excellent energy efficiency where the energy dissipated per spike is 3.39 pJ for ESO memristors, while 54.8  μ J for a CPU-based system, 143 nJ for a FPGA-based system, and 20 pJ for the most power-efficient memristor in the literature (HfO2).92,93

(MgNiCoCuZn)O-based ESO memristors show excellent tunability of device parameters; however, the tunable internal time constant was only tuned in the ns range (159 < τ < 279 ns).67 To make ESO memristors more competitive for a wider range of applications, it is desirable to expand the accessible time constant range so that the optimal time constant for each application can be selected. While the conduction of (MgNiCoCuZn)O occurs via electron excitation from trap states, other physical mechanisms, such as ion diffusion or a thermodynamic phase change, can give a longer time constant (up to ms range) or retention period (longer than a year).94 

A long-term memristor based on the high entropy system was first reported using (ZrHfNbTaMoW)O in 202195 where the strategy of compositional tuning was employed to obtain better resistive switching (RS) properties. For example, WO3 memristors show gradual conductance changes; however, it is challenged by poor retention. HfO2 memristors show good retention but abrupt conduction changes. (ZrHfNbTaMoW)O memristors demonstrated the strengths of the component binary oxides [Figs. 6(a) and 6(b)]: a gradual conductance modulation, 6-bit operation, and long retention (103 s).95 The RS mechanism here is the migration of VOs and the large amount of VOs that can be accommodated as the charges from VO can be compensated by the valence change of the cations (mainly Mo and W). However, the RS properties still suffer from stochasticity, and compositionally tunable device properties were not demonstrated.

FIG. 6.

Nonvolatile memristors based on the high-entropy system (a) and (b); properties of amorphous (ZrHfNbTaMoW)O high entropy oxide memristors. (a) DC resistive switching showing forming processes (red) are set/reset cycles (black). (b) Conductance measured by pulses showing analog conductance properties. (c) DC resistive switching of spinel-(CrMnFeCoNi)3O4 ESO memristors over 4550 cycles. (a)–(b) and (c) are adapted from Refs. 95 and 96, respectively.

FIG. 6.

Nonvolatile memristors based on the high-entropy system (a) and (b); properties of amorphous (ZrHfNbTaMoW)O high entropy oxide memristors. (a) DC resistive switching showing forming processes (red) are set/reset cycles (black). (b) Conductance measured by pulses showing analog conductance properties. (c) DC resistive switching of spinel-(CrMnFeCoNi)3O4 ESO memristors over 4550 cycles. (a)–(b) and (c) are adapted from Refs. 95 and 96, respectively.

Close modal

Recently, Tsai et al. reported spinel (CrMnFeCoNi)3O4 memristors epitaxially grown on a Nb-doped SrTiO3 conducting substrate96 [Fig. 6(c)]. The switching mechanism is attributed to the spinel-to-rock salt structure transition that accompanies both a valence change of the cations and the formation of oxygen vacancies, resulting in a change of electrical conductivity.96 The electrical measurement shows a high ON/OFF ratio (∼105), endurance (>4550 cycles), long retention time (>104 s), and increased stability.96 Although the control of the valence state in high-entropy materials facilitates the memristive switching properties, the associated phase transition involves coordination changes, reduction of entropy, and the migration of oxygen vacancies toward the electrode. Ultimately, the effects alter the thermodynamic ground state, which is likely to limit the endurance. To achieve endurance sufficient for extensive AI training, it will be required to control phase stability and vacancy movement/pinning.

(MgNiCoCuZn)O-based ESOs have shown superionic conductivity when doped with mobile cations, such as Li+ or Na+, showing the promise for long-term memristors based on ionic transport. Improved ionic mobility and reliability is demonstrated when applied as solid-state electrolytes.97,98 This is because the local lattice distortions in ESOs give rise to an overlapping distribution of site energies for alkali ions and provides a diffusion pathway with a reduced activation energy.99 Design of the ESOs ionic conduction via composition and disorder can be a promising direction for future work and has the potential to allow broader range of internal dynamics for various applications.

The extension of relaxation time into the millisecond timescale opens the possibility for memristors to interplay with biological systems.100 Relaxation timescales in the nanosecond or sub-nanosecond timescales enable memristors to work with signals arising within the conventional digital computer. For example, ESO memristors with nanosecond time constants can be used for a RC-based branch predictor (BP), which predicts the execution of branches in advance and enables pipeline parallelism in modern computers.2,101 To comply with the BP's motivation (enabling pipeline parallelism seamlessly), the branch predictor should make a prediction in one or two cycles using execution history.2,101,102 The cycle limitation has hindered BPs from being complicated (deeper), even though several efforts have been made to utilize the neural network fashion.103,104 In that RC networks have demonstrated outstanding performance over relatively deeper neural networks even with a single readout layer,91,92 a RC-based BP can push the boundaries of BP performance in the dynamic execution circumstance by letting ESO memristors encode execution histories, which are delivered in pulses at low cost and high speed.

Modern algorithms and architectures require non-linear mathematics beyond a simple exponential function.54–57,105 Sigmoid, tanh, GLU, and SoftMax are the most frequently and commonly adopted.54–57,105 In conventional computers, the non-linear calculation relies on an approximation such as Taylor series or the lookup tables (LUT) that hold input-dependent outputs and provide the pre-calculated output according to the nearest inputs, which makes the precision of the function compromised by the power and area efficiency.58,59 On the other hand, a memristor's RS behavior can be described by non-linear equations, therefore, can perform the calculation natively at much lower cost.

In Ref. 67, RS dynamics of (MgNiCoCuZn)O-based ESO memristors are fitted by the stretched exponential function (SEF), which is employed for data processing in a reservoir computing network. For future work, richer RS dynamics can be studied by using various analog state variables such as pulse sequence, time interval (tinterval), amplitude (A), frequency (f), or their combinations. The devices can potentially offer internal dynamics-governed responses whose mathematical description maps to (non-linear) activation functions beyond the SEF, a key part of analog neural network hardware design (Fig. 7). The short time constant, τ, eliminates the need to refresh memristors (reset the state) to guarantee reliable output from the same initial states, leading to better energy efficiency. Collective use of the activation functions with VMM operations accelerated by analog memristor crossbar arrays can offer further improvement by performing various machine learning tasks such as natural language process, computer vision, transformer, and deep learning with the least involvement of ADCs or DACs. Also, the analog crossbar arrays can be implemented by ESO memristors if important requirements, such as retention, endurance, and others, are improved in the future. This will realize ESO memristor-based AI accelerators with transformative energy efficient computing performance compared to CMOS-based computing.

FIG. 7.

Design of activation functions for AI/ML applications. Schematics showing how the waveform of input pulses with varying pulse sequence, time interval (tinterval), amplitude (A), and frequency (f) leads to memristor responses in conductance that depicts different (nonlinear) activation functions adopted by the neural network. ESO memristors can intrinsically perform the functions at a lower cost and faster speed when compared to CMOS circuitry.

FIG. 7.

Design of activation functions for AI/ML applications. Schematics showing how the waveform of input pulses with varying pulse sequence, time interval (tinterval), amplitude (A), and frequency (f) leads to memristor responses in conductance that depicts different (nonlinear) activation functions adopted by the neural network. ESO memristors can intrinsically perform the functions at a lower cost and faster speed when compared to CMOS circuitry.

Close modal

For the use of ESO devices in IC chips, ESO devices must be integrated with Si—the platform for modern electronic technology. Integration of high-quality single-crystalline materials on a Si wafer has remained challenging because the growth of single-crystalline thin films requires (1) a stringent substrate condition such as crystalline state and geometry to support epitaxial growth and/or (2) a high temperature for crystallization that might exceed the thermal budget of IC technology.

ESOs have shown promising pathways toward Si integration. First, it can be directly grown on Si/SiO2 substrates by employing integration techniques such as ion beam assisted deposition (IBAD).106 While films grow in random alignment on a substrate that does not induce epitaxy, the IBAD technique employs ion bombardment during deposition to help align grains of the film azimuthally [Fig. 8(a)]. It is also possible to grow epitaxial ESO thin films on a Si wafer using rock salt template layers such as SrO and CaO or using perovskite template such as SrTiO3107 [Fig. 8(b)]. For example, SrTiO3 has epitaxial relationship with Si, which allows the growth of fully crystalline SrTiO3 thin film at growth temperature < 550 °C.107 Owing to the cubic geometry and relatively small lattice mismatch, ESO thin films can be epitaxially grown on SrTiO3 or MgO/SrTiO3 buffered Si substrate [Fig. 8(c)].

FIG. 8.

Approaches to integrate single-crystalline ESO on Si substrates. (a) Single crystalline ESO can be deposited on amorphous SiO2 surface by IBAD technique. (b) Single-crystalline SrTiO3 can be epitaxially grown on Si wafer. (c) X-ray diffraction showing single-crystalline ESO thin films deposited on MgO/SrTiO3 buffered Si wafer. Figure (b) is adapted from Ref. 107.

FIG. 8.

Approaches to integrate single-crystalline ESO on Si substrates. (a) Single crystalline ESO can be deposited on amorphous SiO2 surface by IBAD technique. (b) Single-crystalline SrTiO3 can be epitaxially grown on Si wafer. (c) X-ray diffraction showing single-crystalline ESO thin films deposited on MgO/SrTiO3 buffered Si wafer. Figure (b) is adapted from Ref. 107.

Close modal

Another benefit of ESOs is the low crystallization temperature (<400  °C) that facilitates back-end-of-line (BEOL) compatibility; therefore, dense integration via vertical stacking is possible. 3D vertical RRAM (VRRAM) array can also provide higher parallelism, capacity, and density for VMM operation.19 Monolithic 3D integration is the most cost-effective route for VRRAM; however, it is challenged by the synthesis of high-quality materials within BEOL constraints (all processing must remain below 450  °C).108 While typical oxide compounds require high deposition temperature to crystallize, the ESO uses configurational entropy and a rapid quench to stabilize the crystalline structure. Physical vapor deposition naturally provides this condition as the plasma/vapor temperature is very high leading to a high entropy and kinetic energy of the species, while the quench is facilitated by the condensation of the species onto the substrate surface that is at much lower temperature.108 Combined with the integration techniques above, further work on BEOL compatibility and 3D integration of ESO devices on Si will be interesting and important future work.

Single-crystalline ESO memristors show the ability to delicately tune the internal transport dynamics via composition control of point defects. This allows implementation of neural network systems for task-specific ML applications with transformative low electricity consumption. Future works, such as tuning broader range of internal dynamics, demonstration of higher functionality, and integration in Si, will make ESO memristors even more promising for sustainable AI computing.

This work was supported by the National Science Foundation through NSF MRSEC DMR-2011839. The authors would also like to acknowledge the many that have contributed to their understanding of entropy stabilized oxides through collaboration and discussion, such as Susan Trolier-McKinstry, Jon-Paul Maria, Christina Rost, and Ismailia Dabo.

The authors have no conflicts to disclose.

Sieun Chae and Sangmin Yoo contributed equally to this work.

Sieun Chae: Data curation (equal); Formal analysis (equal); Investigation (equal); Methodology (equal); Validation (equal); Writing – original draft (equal); Writing – review & editing (equal). Sangmin Yoo: Data curation (equal); Formal analysis (equal); Investigation (equal); Methodology (equal); Writing – original draft (equal); Writing – review & editing (equal). Emmanouil Kioupakis: Conceptualization (equal); Investigation (equal); Methodology (equal); Resources (equal); Writing – review & editing (equal). Wei D. Lu: Conceptualization (equal); Investigation (equal); Methodology (equal); Resources (equal); Supervision (equal); Writing – review & editing (equal). John Heron: Conceptualization (equal); Funding acquisition (equal); Investigation (equal); Project administration (equal); Supervision (equal); Writing – review & editing (equal).

The data that support the findings of this study are available from the corresponding author upon reasonable request.

1.
Semiconductor Research Corporation
,
Decadal Plan for Semiconductors
(
Semiconductor Research Corporation
,
2021
).
2.
D.
Harris
and
S.
Harris
,
Digital Design and Computer Architecture
, 2nd ed. (
Morgan Kaufmann Publishers Inc
.,
San Francisco, CA
,
2012
).
3.
N. R.
Mahapatra
and
B.
Venkatrao
, “
The processor-memory Bottleneck: Problems and solutions
,”
XRDS
5
(
3es
),
2-es
(
1999
).
4.
D.
Burger
,
J. R.
Goodman
, and
A.
Kägi
, “
Memory bandwidth limitations of future microprocessors
,” in
Proceedings of the 23rd Annual International Symposium on Computer Architecture
(
Association for Computing Machinery
,
New York, NY
,
1996
), pp.
78
89
.
5.
D.
Patterson
, “
A case for intelligent RAM: IRAM
,” in
IEEE/ACM International Symposium on Microarchitecture
(
IEEE
,
1997
).
6.
S.
Lee
,
S.
Kang
,
J.
Lee
,
H.
Kim
,
E.
Lee
,
S.
Seo
,
H.
Yoon
,
S.
Lee
,
K.
Lim
,
H.
Shin
,
J.
Kim
,
O.
Seongil
,
A.
Iyer
,
D.
Wang
,
K.
Sohn
, and
N. S.
Kim
, “
Hardware architecture and software stack for PIM based on commercial DRAM technology: Industrial product
,” in
ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA)
(
IEEE
,
2021
), pp.
43
56
.
7.
S.
Ghose
,
A.
Boroumand
,
J. S.
Kim
,
J.
Gómez-Luna
, and
O.
Mutlu
, “
Processing-in-memory: A workload-driven perspective
,”
IBM J. Res. Dev.
63
(
6
),
3:1
3:19
(
2019
).
8.
M.
He
,
C.
Song
,
I.
Kim
,
C.
Jeong
,
S.
Kim
,
I.
Park
,
M.
Thottethodi
, and
T. N.
Vijaykumar
, “
Newton: A DRAM-maker's accelerator-in-memory (AiM) architecture for machine learning
,” in
Proceedings of the Annual International Symposium on Microarchitecture (MICRO)
(
IEEE Computer Society
,
2020
), pp.
372
385
.
9.
A.
Sebastian
,
M.
Le Gallo
,
R.
Khaddam-Aljameh
, and
E.
Eleftheriou
, “
Memory devices and applications for in-memory computing
,”
Nat. Nanotechnol.
15
(
7
),
529
544
(
2020
).
10.
G.
Krishnan
,
Z.
Wang
,
I.
Yeo
,
L.
Yang
,
J.
Meng
,
M.
Liehr
,
R. V.
Joshi
,
N. C.
Cady
,
D.
Fan
,
J.-S.
Seo
, and
Y.
Cao
, “
Hybrid RRAM/SRAM in-memory computing for robust DNN acceleration
,”
IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst.
41
(
11
),
4241
4252
(
2022
).
11.
B.
Chen
,
F.
Cai
,
J.
Zhou
,
W.
Ma
,
P.
Sheridan
, and
W. D.
Lu
, “
Efficient in-memory computing architecture based on crossbar arrays
,” in
IEEE International Electron Devices Meeting (IEDM)
(
IEEE
,
2015
), pp.
17.5.1
17.5.4
.
12.
S.
Jung
,
H.
Lee
,
S.
Myung
,
H.
Kim
,
S. K.
Yoon
,
S.-W.
Kwon
,
Y.
Ju
,
M.
Kim
,
W.
Yi
,
S.
Han
,
B.
Kwon
,
B.
Seo
,
K.
Lee
,
G.-H.
Koh
,
K.
Lee
,
Y.
Song
,
C.
Choi
,
D.
Ham
, and
S. J.
Kim
, “
A crossbar array of magnetoresistive memory devices for in-memory computing
,”
Nature
601
(
7892
),
211
216
(
2022
).
13.
X.
Wang
,
R.
Pinkham
,
M. A.
Zidan
,
F.-H.
Meng
,
M. P.
Flynn
,
Z.
Zhang
, and
W. D.
Lu
, “
TAICHI: A tiled architecture for in-memory computing and heterogeneous integration
,”
IEEE Trans. Circuits Syst. II
69
(
2
),
559
563
(
2022
).
14.
G.
Krishnan
,
J.
Sun
,
J.
Hazra
,
X.
Du
,
M.
Liehr
,
Z.
Li
,
K.
Beckmann
,
R. V.
Joshi
,
N. C.
Cady
, and
Y.
Cao
, “
Robust RRAM-based in-memory computing in light of model stability
,” in
IEEE International Reliability Physics Symposium (IRPS)
(
IEEE
,
2021
), pp.
1
5
.
15.
J.
Meng
,
I.
Yeo
,
W.
Shim
,
L.
Yang
,
D.
Fan
,
S.
Yu
, and
J.-S.
Seo
, “
Sparse and robust RRAM-based efficient in-memory computing for DNN inference
,” in
IEEE International Reliability Physics Symposium (IRPS)
(
IEEE
,
2022
), pp.
3C.1-1
3C.1-6
.
16.
S.
Yin
,
J. S.
Seo
,
Y.
Kim
,
X.
Han
,
H.
Barnaby
,
S.
Yu
,
Y.
Luo
,
W.
He
,
X.
Sun
, and
J. J.
Kim
, “
Monolithically integrated RRAM- and CMOS-based in-memory computing optimizations for efficient deep learning
,”
IEEE Micro
39
(
6
),
54
63
(
2019
).
17.
S.
Yin
,
X.
Sun
,
S.
Yu
, and
J.-S.
Seo
, “
High-throughput in-memory computing for binary deep neural networks with monolithically integrated RRAM and 90-nm CMOS
,”
IEEE Trans. Electron Devices
67
(
10
),
4185
4192
(
2020
).
18.
S.
Xie
,
C.
Ni
,
A.
Sayal
,
P.
Jain
,
F.
Hamzaoglu
, and
J. P.
Kulkarni
, “
16.2 eDRAM-CIM: Compute-in-memory design with reconfigurable embedded-dynamic-memory array realizing adaptive data converters and charge-domain computing
,” in
IEEE International Solid-State Circuits Conference (ISSCC)
(
Institute of Electrical and Electronics Engineers Inc
.,
2021
), pp.
248
250
.
19.
Q.
Huo
,
Y.
Yang
,
Y.
Wang
,
D.
Lei
,
X.
Fu
,
Q.
Ren
,
X.
Xu
,
Q.
Luo
,
G.
Xing
,
C.
Chen
,
X.
Si
,
H.
Wu
,
Y.
Yuan
,
Q.
Li
,
X.
Li
,
X.
Wang
,
M.-F.
Chang
,
F.
Zhang
, and
M.
Liu
, “
A computing-in-memory macro based on three-dimensional resistive random-access memory
,”
Nat. Electron.
5
(
7
),
469
477
(
2022
).
20.
A.
Sebastian
,
M.
Le Gallo
, and
E.
Eleftheriou
, “
Computational phase-change memory: Beyond von Neumann computing
,”
J. Phys. D
52
,
443002
(
2019
).
21.
Y.-C.
Chiu
,
W.-S.
Khwa
,
C.-S.
Yang
,
S.-H.
Teng
,
H.-Y.
Huang
,
F.-C.
Chang
,
Y.
Wu
,
Y.-A.
Chien
,
F.-L.
Hsieh
,
C.-Y.
Li
,
G.-Y.
Lin
,
P.-J.
Chen
,
T.-H.
Pan
,
C.-C.
Lo
,
R.-S.
Liu
,
C.-C.
Hsieh
,
K.-T.
Tang
,
M.-S.
Ho
,
C.-P.
Lo
,
Y.-D.
Chih
,
T.-Y. J.
Chang
, and
M.-F.
Chang
, “
A CMOS-integrated spintronic compute-in-memory macro for secure AI edge devices
,”
Nat. Electron.
6
(
7
),
534
543
(
2023
).
22.
D.
Wang
,
P.
Wang
,
S.
Mondal
,
M.
Hu
,
Y.
Wu
,
T.
Ma
, and
Z.
Mi
, “
Ultrathin nitride ferroic memory with large ON/OFF ratios for analog in-memory computing
,”
Adv. Mater.
35
,
2210628
(
2023
).
23.
M. A.
Zidan
,
Y. J.
Jeong
,
J.
Lee
,
B.
Chen
,
S.
Huang
,
M. J.
Kushner
, and
W. D.
Lu
, “
A general memristor-based partial differential equation solver
,”
Nat. Electron.
1
(
7
),
411
420
(
2018
).
24.
M.
Prezioso
,
F.
Merrikh-Bayat
,
B. D.
Hoskins
,
G. C.
Adam
,
K. K.
Likharev
, and
D. B.
Strukov
, “
Training and operation of an integrated neuromorphic network based on metal-oxide memristors
,”
Nature
521
(
7550
),
61
64
(
2015
).
25.
F.
Cai
,
J. M.
Correll
,
S. H.
Lee
,
Y.
Lim
,
V.
Bothra
,
Z.
Zhang
,
M. P.
Flynn
, and
W. D.
Lu
, “
A fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations
,”
Nat. Electron.
2
(
7
),
290
299
(
2019
).
26.
P.
Yao
,
H.
Wu
,
B.
Gao
,
J.
Tang
,
Q.
Zhang
,
W.
Zhang
,
J. J.
Yang
, and
H.
Qian
, “
Fully hardware-implemented memristor convolutional neural network
,”
Nature
577
(
7792
),
641
646
(
2020
).
27.
L.
Deng
,
D.
Wang
,
Z.
Zhang
,
P.
Tang
,
G.
Li
, and
J.
Pei
, “
Energy consumption analysis for various memristive networks under different learning strategies
,”
Phys. Lett. A
380
(
7
),
903
909
(
2016
).
28.
M. A.
Zidan
,
J. P.
Strachan
, and
W. D.
Lu
, “
The future of electronics based on memristive systems
,”
Nat. Electron.
1
(
1
),
22
29
(
2018
).
29.
H. S. P.
Wong
,
S.
Raoux
,
S.
Kim
,
J.
Liang
,
J. P.
Reifenberg
,
B.
Rajendran
,
M.
Asheghi
, and
K. E.
Goodson
, “
Phase change memory
,” in
Proceedings of the IEEE
(
Institute of Electrical and Electronics Engineers Inc
.,
2010
), pp.
2201
2227
.
30.
J.
Muller
,
T. S.
Boscke
,
S.
Muller
,
E.
Yurchuk
,
P.
Polakowski
,
J.
Paul
,
D.
Martin
,
T.
Schenk
,
K.
Khullar
,
A.
Kersch
,
W.
Weinreich
,
S.
Riedel
,
K.
Seidel
,
A.
Kumar
,
T. M.
Arruda
,
S. V.
Kalinin
,
T.
Schlosser
,
R.
Boschke
,
R.
van Bentum
,
U.
Schroder
, and
T.
Mikolajick
, “
Ferroelectric hafnium oxide: A CMOS-compatible and highly scalable approach to future ferroelectric memories
,” in
IEEE International Electron Devices Meeting
(
IEEE
,
2013
), pp.
10.8.1
10.8.4
.
31.
T.
Soliman
,
F.
Muller
,
T.
Kirchner
,
T.
Hoffmann
,
H.
Ganem
,
E.
Karimov
,
T.
Ali
,
M.
Lederer
,
C.
Sudarshan
,
T.
Kampfe
,
A.
Guntoro
, and
N.
Wehn
, “
Ultra-low power flexible precision FeFET based analog in-memory computing
,” in
International Electron Devices Meeting (IEDM)
(
Institute of Electrical and Electronics Engineers Inc
.,
2020
), pp.
29.2.1
29.2.4
.
32.
International Roadmap for Devices and Systems
,
2023 Update Beyond CMOS
(
Institute of Electrical and Electronics Engineers
,
2023
).
33.
J.
Park
,
A.
Kumar
,
Y.
Zhou
,
S.
Oh
,
J. H.
Kim
,
Y.
Shi
,
S.
Jain
,
G.
Hota
,
E.
Qiu
,
A. L.
Nagle
,
I. K.
Schuller
,
C. D.
Schuman
,
G.
Cauwenberghs
, and
D.
Kuzum
, “
Multi-level, forming and filament free, bulk switching trilayer RRAM for neuromorphic computing at the edge
,”
Nat. Commun.
15
(
1
),
3492
(
2024
).
34.
A. A.
Talin
,
Y.
Li
,
D. A.
Robinson
,
E. J.
Fuller
, and
S.
Kumar
, “
ECRAM materials, devices, circuits and architectures: A perspective
,”
Adv. Mater.
35
(
37
),
2204771
(
2023
).
35.
S.
Brivio
,
S.
Spiga
, and
D.
Ielmini
, “
HfO2-based resistive switching memory devices for neuromorphic computing
,”
Neuromorphic Comput. Eng.
2
(
4
),
042001
(
2022
).
36.
C. J.
Lin
,
S. H.
Kang
,
Y. J.
Wang
,
K.
Lee
,
X.
Zhu
,
W. C.
Chen
,
X.
Li
,
W. N.
Hsu
,
Y. C.
Kao
,
M. T.
Liu
,
W. C.
Chen
,
Y.
Lin
,
M.
Nowak
,
N.
Yu
, and
L.
Tran
, “
45 nm low power CMOS logic compatible embedded STT MRAM utilizing a reverse-connection 1T/1MTJ cell
,” in
IEEE International Electron Devices Meeting (IEDM)
(
IEEE
,
2009
), pp.
1
4
.
37.
T.
Scheike
,
Z.
Wen
,
H.
Sukegawa
, and
S.
Mitani
, “
631% room temperature tunnel magnetoresistance with large oscillation effect in CoFe/MgO/CoFe(001) junctions
,”
Appl. Phys. Lett.
122
(
11
),
112404
(
2023
).
38.
G. C.
Adam
,
B. D.
Hoskins
,
M.
Prezioso
,
F.
Merrikh-Bayat
,
B.
Chakrabarti
, and
D. B.
Strukov
, “
3-D memristor crossbars for analog and neuromorphic computing applications
,”
IEEE Trans. Electron Devices
64
(
1
),
312
318
(
2017
).
39.
M.
Hu
,
C. E.
Graves
,
C.
Li
,
Y.
Li
,
N.
Ge
,
E.
Montgomery
,
N.
Davila
,
H.
Jiang
,
R. S.
Williams
,
J. J.
Yang
,
Q.
Xia
, and
J. P.
Strachan
, “
Memristor-based analog computation and neural network classification with a dot product engine
,”
Adv. Mater.
30
(
9
),
1705914
(
2018
).
40.
Q.
Liu
,
B.
Gao
,
P.
Yao
,
D.
Wu
,
J.
Chen
,
Y.
Pang
,
W.
Zhang
,
Y.
Liao
,
C.-X.
Xue
,
W.-H.
Chen
,
J.
Tang
,
Y.
Wang
,
M.-F.
Chang
,
H.
Qian
, and
H.
Wu
, “
33.2 A fully integrated analog ReRAM based 78.4TOPS/W compute-in-memory chip with fully parallel MAC computing
,” in
IEEE International Solid- State Circuits Conference (ISSCC)
(
IEEE
,
2020
), pp.
500
502
.
41.
D.
Wang
,
R.
Tang
,
H.
Lin
,
L.
Liu
,
N.
Xu
,
Y.
Sun
,
X.
Zhao
,
Z.
Wang
,
D.
Wang
,
Z.
Mai
,
Y.
Zhou
,
N.
Gao
,
C.
Song
,
L.
Zhu
,
T.
Wu
,
M.
Liu
, and
G.
Xing
, “
Spintronic leaky-integrate-fire spiking neurons with self-reset and winner-takes-all for neuromorphic computing
,”
Nat. Commun.
14
(
1
),
1068
(
2023
).
42.
T.
Miao
,
B.
Cui
,
C.
Huang
,
D.
Wang
,
L.
Liu
,
W.
Liu
,
Y.
Li
,
R.
Chu
,
X.
Ren
,
L.
Liu
,
B.
Cheng
,
G.
Zhou
,
H.
Qin
,
G.
Xing
, and
J.
Hu
, “
Gate-tunable anisotropic oxygen ion migration in SrCoOx: Toward emerging oxide-based artificial synapses
,”
Adv. Intell. Syst.
5
(
3
),
2200287
(
2023
).
43.
J. M.
Correll
,
S. H.
Lee
,
F.
Cai
,
V.
Bothra
,
Y.
Lim
,
Z.
Zhang
,
W. D.
Lu
, and
M. P.
Flynn
, “
Analog computation with RRAM and supporting circuits
,” in
Analog Circuits for Machine Learning, Current/Voltage/Temperature Sensors, and High-Speed Communication: Advances in Analog Circuit Design 2021
, edited by
P.
Harpe
,
K. A. A.
Makinwa
, and
A.
Baschirotto
(
Springer International Publishing
,
Cham
,
2022
), pp.
17
32
.
44.
X.
Chen
,
T.
Song
, and
Y.
Han
, “
RRAM-based analog in-memory computing: Invited paper
,” in
IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH)
(
IEEE
,
2021
), pp.
1
6
.
45.
H.
Jiang
,
W.
Li
,
S.
Huang
,
S.
Cosemans
,
F.
Catthoor
, and
S.
Yu
, “
Analog-to-digital converter design exploration for compute-in-memory accelerators
,”
IEEE Des. Test
39
(
2
),
48
55
(
2022
).
46.
S.
Yu
,
X.
Sun
,
X.
Peng
, and
S.
Huang
, “
Compute-in-memory with emerging nonvolatile-memories: challenges and prospects
,” in
IEEE Custom Integrated Circuits Conference (CICC)
(
IEEE
,
2020
), pp.
1
4
.
47.
S.
Negi
,
U.
Saxena
,
D.
Sharma
, and
K.
Roy
, “
HCiM: ADC-less hybrid analog-digital compute in memory accelerator for deep learning workloads
,” arXiv:2403.13577 (
2024
).
48.
S.
Kumar
,
X.
Wang
,
J. P.
Strachan
,
Y.
Yang
, and
W. D.
Lu
, “
Dynamical memristors for higher-complexity neuromorphic computing
,”
Nat. Rev. Mater.
7
,
575
591
(
2022
).
49.
T.
Chang
,
S.
Jo
, and
W.
Lu
, “
Short-term memory to long-term memory transition in a nanoscale memristor
,”
ACS Nano
5
(
9
),
7669
7676
(
2011
).
50.
C.
Du
,
W.
Ma
,
T.
Chang
,
P.
Sheridan
, and
W. D.
Lu
, “
Biorealistic implementation of synaptic functions with oxide memristors through internal ionic dynamics
,”
Adv. Funct. Mater.
25
(
27
),
4290
4299
(
2015
).
51.
S.
Kim
,
S.
Choi
,
J.
Lee
, and
W. D.
Lu
, “
Tuning resistive switching characteristics of tantalum oxide memristors through Si doping
,”
ACS Nano
8
(
10
),
10262
10269
(
2014
).
52.
S.
Kim
,
C.
Du
,
P.
Sheridan
,
W.
Ma
,
S.
Choi
, and
W. D.
Lu
, “
Experimental demonstration of a second-order memristor and its ability to biorealistically implement synaptic plasticity
,”
Nano Lett.
15
(
3
),
2203
2211
(
2015
).
53.
S.
Yoo
,
Y.
Wu
,
Y.
Park
, and
W. D.
Lu
, “
Tuning resistive switching behavior by controlling internal ionic dynamics for biorealistic implementation of synaptic plasticity
,”
Adv. Electron. Mater.
8
(
8
),
2101025
(
2022
).
54.
J. S.
Bridle
, “
Probabilistic interpretation of feedforward classification network outputs, with relationships to statistical pattern recognition
,” in
Neurocomputing
, edited by
F. F.
Soulié
and
J.
Hérault
(
Springer
,
Berlin, Heidelberg
,
1990
), pp.
227
236
.
55.
W. A.
Little
and
G. L.
Shaw
, “
Analytic study of the memory storage capacity of a neural network
,”
Math. Biosci.
39
(
3
),
281
290
(
1978
).
56.
W. A.
Little
, “
The existence of persistent states in the brain
,”
Math. Biosci.
19
(
1
),
101
120
(
1974
).
57.
K.
Fukushima
, “
Cognitron: A self-organizing multilayered neural network
,”
Biol. Cybern.
20
(
3
),
121
136
(
1975
).
58.
P.
Nilsson
,
A. U. R.
Shaik
,
R.
Gangarajaiah
, and
E.
Hertz
, “
Hardware implementation of the exponential function using Taylor series
,” in
2014 NORCHIP
(
IEEE
,
2014
), pp.
1
4
.
59.
X.
Dong
,
X.
Zhu
, and
D.
Ma
, “
Hardware implementation of Softmax function based on piecewise LUT
,” in
IEEE International Workshop on Future Computing (IWOFC)
(
IEEE
,
2019
), pp.
1
3
.
60.
H.
Touvron
,
T.
Lavril
,
G.
Izacard
,
X.
Martinet
,
M.-A.
Lachaux
,
T.
Lacroix
,
B.
Rozière
,
N.
Goyal
,
E.
Hambro
,
F.
Azhar
,
A.
Rodriguez
,
A.
Joulin
,
E.
Grave
, and
G.
Lample
, “
LLaMA: Open and efficient foundation language models
,” arXiv:2302.13971 (
2023
).
61.
H.
Touvron
,
L.
Martin
,
K.
Stone
,
P.
Albert
,
A.
Almahairi
,
Y.
Babaei
,
N.
Bashlykov
,
S.
Batra
,
P.
Bhargava
,
S.
Bhosale
,
D.
Bikel
,
L.
Blecher
,
C. C.
Ferrer
,
M.
Chen
,
G.
Cucurull
,
D.
Esiobu
,
J.
Fernandes
,
J.
Fu
,
W.
Fu
,
B.
Fuller
,
C.
Gao
,
V.
Goswami
,
N.
Goyal
,
A.
Hartshorn
,
S.
Hosseini
,
R.
Hou
,
H.
Inan
,
M.
Kardas
,
V.
Kerkez
,
M.
Khabsa
,
I.
Kloumann
,
A.
Korenev
,
P. S.
Koura
,
M.-A.
Lachaux
,
T.
Lavril
,
J.
Lee
,
D.
Liskovich
,
Y.
Lu
,
Y.
Mao
,
X.
Martinet
,
T.
Mihaylov
,
P.
Mishra
,
I.
Molybog
,
Y.
Nie
,
A.
Poulton
,
J.
Reizenstein
,
R.
Rungta
,
K.
Saladi
,
A.
Schelten
,
R.
Silva
,
E. M.
Smith
,
R.
Subramanian
,
X. E.
Tan
,
B.
Tang
,
R.
Taylor
,
A.
Williams
,
J. X.
Kuan
,
P.
Xu
,
Z.
Yan
,
I.
Zarov
,
Y.
Zhang
,
A.
Fan
,
M.
Kambadur
,
S.
Narang
,
A.
Rodriguez
,
R.
Stojnic
,
S.
Edunov
, and
T.
Scialom
, “
LLaMA 2: open foundation and fine-tuned chat models
,” arXiv:2307.09288 (
2023
).
62.
T. B.
Brown
,
B.
Mann
,
N.
Ryder
,
M.
Subbiah
,
J.
Kaplan
,
P.
Dhariwal
,
A.
Neelakantan
,
P.
Shyam
,
G.
Sastry
,
A.
Askell
,
S.
Agarwal
,
A.
Herbert-Voss
,
G.
Krueger
,
T.
Henighan
,
R.
Child
,
A.
Ramesh
,
D. M.
Ziegler
,
J.
Wu
,
C.
Winter
,
C.
Hesse
,
M.
Chen
,
E.
Sigler
,
M.
Litwin
,
S.
Gray
,
B.
Chess
,
J.
Clark
,
C.
Berner
,
S.
McCandlish
,
A.
Radford
,
I.
Sutskever
, and
D.
Amodei
, “
Language models are few-shot learners
,” arXiv:2005.14165 (
2020
).
63.
A.
Radford
,
J.
Wu
,
R.
Child
,
D.
Luan
,
D.
Amodei
, and
I.
Sutskever
, “
Language models are unsupervised multitask learners
,” (unpublished) (
2019
).
64.
W.
Wan
,
R.
Kubendran
,
C.
Schaefer
,
S. B.
Eryilmaz
,
W.
Zhang
,
D.
Wu
,
S.
Deiss
,
P.
Raina
,
H.
Qian
,
B.
Gao
,
S.
Joshi
,
H.
Wu
,
H.-S. P.
Wong
, and
G.
Cauwenberghs
, “
A compute-in-memory chip based on resistive random-access memory
,”
Nature
608
(
7923
),
504
512
(
2022
).
65.
Y.
Li
,
E. J.
Fuller
,
J. D.
Sugar
,
S.
Yoo
,
D. S.
Ashby
,
C. H.
Bennett
,
R. D.
Horton
,
M. S.
Bartsch
,
M. J.
Marinella
,
W. D.
Lu
, and
A. A.
Talin
, “
Filament-free bulk resistive memory enables deterministic analogue switching
,”
Adv. Mater.
32
(
45
),
2003984
(
2020
).
66.
Y.
Wu
,
F.
Cai
,
L.
Thomas
,
T.
Liu
,
A.
Nourbakhsh
,
J.
Hebding
,
E.
Smith
,
R.
Quon
,
R.
Smith
,
A.
Kumar
,
A.
Pang
,
J.
Holt
,
R.
Someshwar
,
F.
Nardi
,
J.
Anthis
,
S.-H.
Yen
,
C.
Chevallier
,
A.
Uppala
,
X.
Chen
,
N.
Breil
,
T.
Sherwood
,
K.
Wong
,
W.
Cho
,
D.
Thompson
,
J.
Hsu
,
B.
Ayyagari
,
S.
Krishnan
,
W. D.
Lu
, and
M.
Chudzik
, “
Demonstration of a multi-level μA-range bulk switching ReRAM and its application for keyword spotting
,” in
International Electron Devices Meeting (IEDM)
(
IEEE
,
2022
), pp.
18.4.1
18.4.4
.
67.
S.
Yoo
,
S.
Chae
,
T.
Chiang
,
M.
Webb
,
T.
Ma
,
H.
Paik
,
Y.
Park
,
L.
Williams
,
K.
Nomoto
,
H. G.
Xing
,
S.
Trolier-McKinstry
,
E.
Kioupakis
,
J. T.
Heron
, and
W. D.
Lu
, “
Efficient data processing using tunable entropy-stabilized oxide memristors
,”
Nat. Electron.
7
,
466
(
2024
).
68.
C. M.
Rost
,
E.
Sachet
,
T.
Borman
,
A.
Moballegh
,
E. C.
Dickey
,
D.
Hou
,
J. L.
Jones
,
S.
Curtarolo
, and
J.
Maria
, “
Entropy-stabilized oxides
,”
Nat. Commun.
6
,
8485
(
2015
).
69.
M.
Brahlek
,
M.
Gazda
,
V.
Keppens
,
A. R.
Mazza
,
S. J.
McCormack
,
A.
Mielewczyk-Gryń
,
B.
Musico
,
K.
Page
,
C. M.
Rost
,
S. B.
Sinnott
,
C.
Toher
,
T. Z.
Ward
, and
A.
Yamamoto
, “
What is in a name: Defining ‘high entropy’ oxides
,”
APL Mater.
10
(
11
),
110902
(
2022
).
70.
G. N.
Kotsonis
,
S. S. I.
Almishal
,
F.
Marques dos Santos Vieira
,
V. H.
Crespi
,
I.
Dabo
,
C. M.
Rost
, and
J.-P.
Maria
, “
High-entropy oxides: Harnessing crystalline disorder for emergent functionality
,”
J. Am. Ceram. Soc.
106
(
10
),
5587
5611
(
2023
).
71.
P. B.
Meisenheimer
and
J. T.
Heron
, “
Oxides and the high entropy regime: A new mix for engineering physical properties
,”
MRS Adv.
5
(
64
),
3419
3436
(
2020
).
72.
B. L.
Musicó
,
D.
Gilbert
,
T. Z.
Ward
,
K.
Page
,
E.
George
,
J.
Yan
,
D.
Mandrus
, and
V.
Keppens
, “
The emergent field of high entropy oxides: Design, prospects, challenges, and opportunities for tailoring material properties
,”
APL Mater.
8
(
4
),
040912
(
2020
).
73.
Y.
Sun
,
T.
Wu
,
Z.
Bao
,
J.
Moon
,
Z.
Huang
,
Z.
Chen
,
H.
Chen
,
M.
Li
,
Z.
Yang
,
M.
Chi
,
T. J.
Toops
,
Z.
Wu
,
D. E.
Jiang
,
J.
Liu
, and
S.
Dai
, “
Defect engineering of ceria nanocrystals for enhanced catalysis via a high-entropy oxide strategy
,”
ACS Cent. Sci.
8
(
8
),
1081
1090
(
2022
).
74.
C. M.
Rost
,
Z.
Rak
,
D. W.
Brenner
, and
J.-P.
Maria
, “
Local structure of the MgxNixCoxCuxZnxO(x=0.2) entropy-stabilized oxide: An EXAFS study
,”
J. Am. Ceram. Soc.
100
(
6
),
2732
2738
(
2017
).
75.
G.
Anand
,
A. P.
Wynn
,
C. M.
Handley
, and
C. L.
Freeman
, “
Phase stability and distortion in high-entropy oxides
,”
Acta Mater.
146
,
119
125
(
2018
).
76.
P. B.
Meisenheimer
,
L. D.
Williams
,
S. H.
Sung
,
J.
Gim
,
P.
Shafer
,
G. N.
Kotsonis
,
J. P.
Maria
,
M.
Trassin
,
R.
Hovden
,
E.
Kioupakis
, and
J. T.
Heron
, “
Magnetic frustration control through tunable stereochemically driven disorder in entropy-stabilized oxides
,”
Phys. Rev. Mater.
3
(
10
),
104420
(
2019
).
77.
Z.
Rák
,
J.-P.
Maria
, and
D. W.
Brenner
, “
Evidence for Jahn-Teller compression in the (Mg, Co, Ni, Cu, Zn)O entropy-stabilized oxide: A DFT study
,”
Mater. Lett.
217
,
300
303
(
2018
).
78.
D.
Berardan
,
A. K.
Meena
,
S.
Franger
,
C.
Herrero
, and
N.
Dragoe
, “
Controlled Jahn-Teller distortion in (MgCoNiCuZn)O-based high entropy oxides
,”
J. Alloys Compd.
704
,
693
700
(
2017
).
79.
L. K.
Bhaskar
,
V.
Nallathambi
, and
R.
Kumar
, “
Critical role of cationic local stresses on the stabilization of entropy-stabilized transition metal oxides
,”
J. Am. Ceram. Soc.
103
(
5
),
3416
3424
(
2020
).
80.
S.
Chae
,
L.
Williams
,
J.
Lee
,
J. T.
Heron
, and
E.
Kioupakis
, “
Effects of local compositional and structural disorder on vacancy formation in entropy-stabilized oxides from first-principles
,”
NPJ Comput. Mater.
8
(
1
),
95
(
2022
).
81.
G. N.
Kotsonis
,
P. B.
Meisenheimer
,
L.
Miao
,
J.
Roth
,
B.
Wang
,
P.
Shafer
,
R.
Engel-Herbert
,
N.
Alem
,
J. T.
Heron
,
C. M.
Rost
, and
J.-P.
Maria
, “
Property and cation valence engineering in entropy-stabilized oxide thin films
,”
Phys. Rev. Mater.
4
(
10
),
100401
(
2020
).
82.
V.
Jacobson
,
J.
Huang
,
C. J.
Titus
,
R. W.
Smaha
,
M.
Papac
,
S. J.
Lee
,
A.
Zakutayev
, and
G. L.
Brennecka
, “
The role of Co valence in charge transport in the entropy-stabilized oxide (Mg0.2Co0.2Ni0.2Cu0.2Zn0.2)O
,”
J. Am. Ceram. Soc.
106
(
2
),
1531
1539
(
2023
).
83.
V.
Jacobson
,
D.
Diercks
,
B.
To
,
A.
Zakutayev
, and
G.
Brennecka
, “
Thin film growth effects on electrical conductivity in entropy stabilized oxides
,”
J. Eur. Ceram. Soc.
41
(
4
),
2617
2624
(
2021
).
84.
B. I.
Shklovskii
and
A. L.
Efros
, “
Variable-range hopping conduction
,” in
Electronic Properties of Doped Semiconductors
(
Springer
,
Berlin, Heidelberg
,
1984
), pp.
202
227
.
85.
Z.
Wang
,
C.
Li
,
W.
Song
,
M.
Rao
,
D.
Belkin
,
Y.
Li
,
P.
Yan
,
H.
Jiang
,
P.
Lin
,
M.
Hu
,
J. P.
Strachan
,
N.
Ge
,
M.
Barnell
,
Q.
Wu
,
A. G.
Barto
,
Q.
Qiu
,
R. S.
Williams
,
Q.
Xia
, and
J. J.
Yang
, “
Reinforcement learning with analogue memristor arrays
,”
Nat. Electron.
2
(
3
),
115
124
(
2019
).
86.
J. C.
Phillips
, “
Stretched exponential relaxation in molecular and electronic glasses
,”
Rep. Prog. Phys.
59
,
1133
1207
(
1996
).
87.
Z. W.
Wu
,
W.
Kob
,
W.
Wang
, and
L.
Xu
, “
Stretched and compressed exponentials in the relaxation dynamics of a metallic glass-forming melt
,”
Nat. Commun.
9
,
5334
(
2018
).
88.
S.
Yoo
,
E. Y.-J.
Lee
,
Z.
Wang
,
X.
Wang
, and
W. D.
Lu
, “
RN-Net: Reservoir nodes-enabled neuromorphic vision sensing network
,” arXiv:2303.10770 (
2023
).
89.
G.
Gallego
,
T.
Delbruck
,
G.
Orchard
,
C.
Bartolozzi
,
B.
Taba
,
A.
Censi
,
S.
Leutenegger
,
A. J.
Davison
,
J.
Conradt
,
K.
Daniilidis
, and
D.
Scaramuzza
, “
Event-based vision: A survey
,”
IEEE Trans. Pattern Anal. Mach. Intell.
44
(
1
),
154
180
(
2022
).
90.
Y.
Wang
,
B.
Du
,
Y.
Shen
,
K.
Wu
,
G.
Zhao
,
J.
Sun
, and
H.
Wen
, “
EV-gait: Event-based robust gait recognition using dynamic vision sensors
,” in
Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(
IEEE
,
2019
), pp.
6351
6360
.
91.
C.
Du
,
F.
Cai
,
M. A.
Zidan
,
W.
Ma
,
S. H.
Lee
, and
W. D.
Lu
, “
Reservoir computing using dynamic memristors for temporal information processing
,”
Nat. Commun.
8
(
1
),
1
10
(
2017
).
92.
J.
Moon
,
W.
Ma
,
J. H.
Shin
,
F.
Cai
,
C.
Du
,
S. H.
Lee
, and
W. D.
Lu
, “
Temporal data classification and forecasting using a memristor-based reservoir computing system
,”
Nat. Electron.
2
(
10
),
480
487
(
2019
).
93.
D.
Lee
,
M.
Kwak
,
K.
Moon
,
W.
Choi
,
J.
Park
,
J.
Yoo
,
J.
Song
,
S.
Lim
,
C.
Sung
,
W.
Banerjee
, and
H.
Hwang
, “
Various threshold switching devices for integrate and fire neuron applications
,”
Adv. Electron. Mater.
5
(
9
),
1800866
(
2019
).
94.
E.
Barsoukov
and
J. R.
Macdonald
,
Impedance Spectroscopy: Theory, Experiment, and Applications
(
Wiley
,
2005
).
95.
M.
Ahn
,
Y.
Park
,
S. H.
Lee
,
S.
Chae
,
J.
Lee
,
J. T.
Heron
,
E.
Kioupakis
,
W. D.
Lu
, and
J. D.
Phillips
, “
Memristors based on (Zr, Hf, Nb, Ta, Mo, W) high-entropy oxides
,”
Adv. Electron. Mater.
7
(
5
),
2001258
(
2021
).
96.
J.-Y.
Tsai
,
J.-Y.
Chen
,
C.-W.
Huang
,
H.-Y.
Lo
,
W.-E.
Ke
,
Y.-H.
Chu
, and
W.-W.
Wu
, “
A high-entropy-oxides-based memristor: Outstanding resistive switching performance and mechanisms in atomic structural evolution
,”
Adv. Mater.
35
(
41
),
2302979
(
2023
).
97.
A.
Sarkar
,
L.
Velasco
,
D.
Wang
,
Q.
Wang
,
G.
Talasila
,
L.
de Biasi
,
C.
Kübel
,
T.
Brezesinski
,
S. S.
Bhattacharya
,
H.
Hahn
, and
B.
Breitung
, “
High entropy oxides for reversible energy storage
,”
Nat. Commun.
9
(
1
),
3400
(
2018
).
98.
D.
Bérardan
,
S.
Franger
,
A. K.
Meena
, and
N.
Dragoe
, “
Room temperature lithium superionic conductivity in high entropy oxides
,”
J. Mater. Chem. A
4
(
24
),
9536
9541
(
2016
).
99.
Y.
Zeng
,
B.
Ouyang
,
J.
Liu
,
Y.-W.
Byeon
,
Z.
Cai
,
L. J.
Miara
,
Y.
Wang
, and
G.
Ceder
, “
High-entropy mechanism to boost ionic conductivity
,”
Science
378
(
6626
),
1320
1324
(
2022
).
100.
D. V.
Buonomano
, “
The biology of time across different scales
,”
Nat. Chem. Biol.
3
(
10
),
594
597
(
2007
).
101.
R.
Joseph
, “
A survey of deep learning techniques for dynamic branch prediction
,” arXiv:2112.14911 (
2021
).
102.
C.-K.
Lin
and
S. J.
Tarsa
, “
Branch prediction is not a solved problem: Measurements, opportunities, and future directions
,” in
IEEE International Symposium on Workload Characterization (IISWC)
(
IEEE
,
2019
), pp.
228
238
.
103.
S.
Zangeneh
,
S.
Pruett
,
S.
Lym
, and
Y. N.
Patt
, “
BranchNet: A convolutional neural network to predict hard-to-predict branches
,” in
53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO)
(
IEEE
,
2020
), pp.
118
130
.
104.
D. A.
Jimenez
and
C.
Lin
, “
Dynamic branch prediction with perceptrons
,” in
Proceedings HPCA Seventh International Symposium on High-Performance Computer Architecture
(
IEEE
,
2001
), pp.
197
206
.
105.
B.
Xu
,
N.
Wang
,
T.
Chen
, and
M.
Li
, “
Empirical evaluation of rectified activations in convolutional network
,” arXiv:1505.00853 (
2015
).
106.
S.
Wang
,
C.
Antonakos
,
C.
Bordel
,
D. S.
Bouma
,
P.
Fischer
, and
F.
Hellman
, “
Ultrathin IBAD MgO films for epitaxial growth on amorphous substrates and sub-50 nm membranes
,”
Appl. Phys. Lett.
109
(
19
),
191603
(
2016
).
107.
W.
Guo
,
A. B.
Posadas
, and
A. A.
Demkov
, “
Epitaxial integration of BaTiO3 on Si for electro-optic applications
,”
J. Vac. Sci. Technol. A
39
(
3
),
030804
(
2021
).
108.
G.
Zhou
,
T.
Sun
,
R.
Younas
, and
C. L.
Hinkle
, “
Materials and device strategies for nanoelectronic 3D heterogeneous integration
,” in
International Conference on Simulation of Semiconductor Processes and Devices (SISPAD)
(
IEEE
,
2021
), pp.
163
166
.