Higher-Order Hamiltonian for Circuits with (alpha,beta) Elements

entropy Article Higher-Order Hamiltonian for Circuits with (α,β) Elements Zdenˇek Biolek 1,2 , Dalibor Biolek 1,2 , Viera Biolková3,* and Zdenˇek Kolka 3 1Department of Microelectronics, Brno University of Technology, 616 00 Brno, Czech Republic; [email protected] (Z.B.); dalibor[email protected] (D.B.) 2Department of Electrical Engineering, University of Defence, 662 10 Brno, Czech Republic 3Department of Radio Electronics, Brno University of Technology, 616 00 Brno, Czech Republic; [email protected].cz *Correspondence: [email protected].cz; Tel.: +420-541-146-584 Received: 22 February 2020; Accepted: 2 April 2020; Published: 5 April 2020   Abstract: The paper studies the construction of the Hamiltonian for circuits built from the ( α , β ) elements of Chua’s periodic table. It starts from the Lagrange function, whose existence is limited to Σ -circuits, i.e., circuits built exclusively from elements located on a common Σ -diagonal of the table. We show that the Hamiltonian can also be constructed via the generalized Tellegen’s theorem. According to the ideas of predictive modeling, the resulting Hamiltonian is made up exclusively of the constitutive relations of the elements in the circuit. Within the frame of Ostrogradsky’s formalism, the simulation scheme of Σ -circuits is designed and examined with the example of a nonlinear Pais–Uhlenbeck oscillator. Keywords: higher-order element; constitutive relation; Hamiltonian; Lagrangian; Chua’s table; memristor; Euler-Lagrange equation 1. Introduction The dynamics of complex nonlinear systems attracts the interest of researchers in various branches of science [ 1 – 4 ]. One of the approaches used for studying system dynamics, predictive modeling, considers the system an interconnection of one-port devices, the α,βelements, also known as Higher Order Elements (HOEs) [ 5 ]. Each HOE guarantees that its terminal quantities are coupled in all circumstances via a constitutive relation. In electrical engineering, the terminal quantities are the generalized voltage v (α) and current i (β) , where the integers α and β denote the orders of the derivative/integral with respect to time (for positive/negative integers). Well-known ( α , β ) elements include resistors (0,0), capacitors (0, − 1), and inductors ( − 1,0), and also the promising memristors ( − 1, − 1), memcapacitors ( − 1, − 2), and meminductors ( − 2, − 1), frequency-dependent resistors (FDNR, FDNC), and others. HOEs are usually represented as points with integer ( α , β ) coordinates in Chua’s periodic table (see Figure 1). The constitutive relation of the element is frequently written in one of the two following forms: v(α)=fi(β), or i(β)=gv(α)(1) where the function f() or g() models the current or voltage representation of the element. The use of HOEs considerably increases the possibilities of analyzing and synthesizing circuits with complex dynamic behavior. Thanks to predictive modeling, many phenomena can be better understood. For example, the hypothetical element called a memristor [ 6 ] helped to explain the peculiar hysteresis behavior observed when measuring various nanomaterials. When Hewlett-Packard reported the first TiO 2 -based working memristive device in 2008 [ 7 ], they reminded the researchers of the original Entropy 2020,22, 412; doi:10.3390/e22040412 www.mdpi.com/journal/entropy Entropy 2020,22, 412 2 of 20 work [ 6 ] that explains this behavior as a characteristic feature of the memristor—a fingerprint. Ongoing research has demonstrated that a pinched hysteresis loop is a regular phenomenon, which takes effect for an arbitrary (α,β) element in the space of the time derivatives of its terminal quantities [8]. The interest in systems with high-order dynamics has led to an extension of Lagrange’s and Hamilton’s formalisms to systems with α , β elements. This is because the original Lagrange’s formalism starts from the fundamental schematic of classical mechanics, i.e., from the point of view of predictive modeling based on the R(0,0), L( − 1,0), and C(0, − 1) elements. Moreover, the system of equations of motion can be generated from one scalar function, the Lagrangian, but only for conservative systems. Recent works [ 9 – 11 ] have extended Lagrange’s formalism to circuits containing memristors, memcapacitors, and meminductors. The following work [ 12 ] defines the potential functions for general ( α , β ) elements from which Lagrangians and dissipative functions are drawn, and rules for generating the equations of motions are established. The potential functions of a general ( α , β ) element are defined for current or voltage representation as integrals: Sα,β=Zv(α)di(β)or ˆ Sα,β=Zi(β)dv(α), (2) which represent a natural generalization of the potential and kinetic energy and the dissipative function of classical mechanics, or the energy of capacitors, inductors, and the content of resistors in classical electrical engineering. Two different representations of potential functions correspond to the concept of functions and co-functions introduced by Millar [13] and Cherry [14] in 1951. Entropy 2020, 21, x 2 of 20 feature of the memristor—a fingerprint. Ongoing research has demonstrated that a pinched hysteresis loop is a regular phenomenon, which takes effect for an arbitrary ( α , β ) element in the space of the time derivatives of its terminal quantities [8]. The interest in systems with high-order dynamics has led to an extension of Lagrange’s and Hamilton’s formalisms to systems with α , β elements. This is because the original Lagrange’s formalism starts from the fundamental schematic of classical mechanics, i.e., from the point of view of predictive modeling based on the R (0,0), L (−1,0), and C (0,−1) elements. Moreover, the system of equations of motion can be generated from one scalar function, the Lagrangian, but only for conservative systems. Recent works [9–11] have extended Lagrange’s formalism to circuits containing memristors, memcapacitors, and meminductors. The following work [12] defines the potential functions for general ( α , β ) elements from which Lagrangians and dissipative functions are drawn, and rules for generating the equations of motions are established. The potential functions of a general ( α , β ) element are defined for current or voltage representation as integrals: () () () () ,, ˆ orSvdiSidv α ββ α αβ αβ ==  , (2) which represent a natural generalization of the potential and kinetic energy and the dissipative function of classical mechanics, or the energy of capacitors, inductors, and the content of resistors in classical electrical engineering. Two different representations of potential functions correspond to the concept of functions and co-functions introduced by Millar [13] and Cherry [14] in 1951. 0 β 1 -1-2 -1 -2 RL C MR MC ML FDNC α 1 Σ=0 Σ=-1 FDNR (a) (b) Figure 1. Visualization of several (α,β) elements in Chua’s table. R, L, C = Resistor, Inductor, and Capacitor; MR, ML, MC = Memristor, Meminductor, and Memcapacitor; FDNR, FDNC = Frequency Dependent Negative Resistor and Frequency Dependent Negative Conductor. (a) Lagrange’s formalism of classical mechanics applies to circuits composed exclusively of L and C elements; the energy, conserved in the circuit, corresponds to the diagonal Σ = −1; (b) an example of the application of a 2nd-order Lagrangian to the description of the Pais–Uhlenbeck oscillator [15] consisting of dissipative R, FDNR, FDNC elements [16]; the power preserved in the circuit corresponds to the diagonal Σ = 0. The classical Lagrangian is of the first order, so it is a function of generalized coordinates and velocities (first-order time derivatives of the coordinates); the resulting equations of motion are of the second order. Higher-order Lagrangians were introduced by Ostrogradsky in [17] as follows: () ( ) () 1 , ,..., , m LL t=xx x (3) Figure 1. Visualization of several ( α , β ) elements in Chua’s table. R,L,C=Resistor, Inductor, and Capacitor; MR,ML,MC =Memristor, Meminductor, and Memcapacitor; FDNR,FDNC =Frequency Dependent Negative Resistor and Frequency Dependent Negative Conductor. (a) Lagrange’s formalism of classical mechanics applies to circuits composed exclusively of Land Celements; the energy, conserved in the circuit, corresponds to the diagonal Σ = − 1; (b) an example of the application of a 2 nd -order Lagrangian to the description of the Pais–Uhlenbeck oscillator [ 15 ] consisting of dissipative R,FDNR,FDNC elements [16]; the power preserved in the circuit corresponds to the diagonal Σ=0. Entropy 2020,22, 412 3 of 20 The classical Lagrangian is of the first order, so it is a function of generalized coordinates and velocities (first-order time derivatives of the coordinates); the resulting equations of motion are of the second order. Higher-order Lagrangians were introduced by Ostrogradsky in [17] as follows: L=Lx,x(1),. . . ,x(m),t(3) The Lagrangian is a function of the 1xnvector of the generalized coordinates x =[x 1 .. x n ] T and their derivatives up to the integer-order m. The system represented by Lagrangian (3) is governed by n equations of motion: ∂L ∂x−d dt ∂L ∂x(1)!+d2 dt2 ∂L ∂x(2)!−. . . +(−1)mdm dtm ∂L ∂x(m)!=0. (4) Equation (4) is a direct consequence of the fact that the system trajectory is extremal to the action A= t2 Z t1 Lx,x(1),. . . ,x(m),tdt, (5) which is the essence of Hamilton’s variational principle [ 18 ]. The higher-order Lagrangian (3) was used for the first time to describe circuits built from HOEs in [ 16 ]. This work demonstrated that the Lagrangian, which has the ability to generate equations of motion, can only be drawn for the Σ -circuits that contain only elements from the common Σ -diagonal of Chua’s table, where the sum of the indices αand βis preserved; thus, Σ=α+β. The Lagrangian then has the form L=X εi (−1)iSior ˆ L=X εi (−1)iˆ Si. (6) The summation is done through all εi elements of the given Σ -diagonal, where iis the position of the element on the diagonal (see Figure 2). The signs in front of the state functions in the sums of (6) are governed by the type (even or odd) of the positions of the elements on the diagonal [ 16 ]. The difference between kinetic and potential energy, transferring between the inertial and the accumulating elements, which are the common form of the Lagrangian used in classical mechanics, are merely a special case of (6). The physical dimension of the Lagrangian is given by the number Σ of the diagonal: [Volt · Amper · sec −Σ ]. This is the energy [Volt · Amper · sec] in LC and the power [Volt · Amper] in resistive circuits. An example of the Lagrangian of the Pais–Uhlenbeck oscillator [ 15 ], consisting of three resistive elements of R,FDNR, and FDNC types, is given in [16]. The transition from the higher-order Lagrangian (3) to the higher-order Hamiltonian is given by the generalized Legendre transformation published by Ostrogradsky in [17]: Hx,x(1), , x(2m−1)=1pT·x(1)+. . . +mpT·x(m)−Lx,x(1),. . . ,x(m)(7) where 1pto mpare vectors of the generalized momenta jp= m X k=j (−1)k−j ∂L ∂x(k)!(k−j) . (8) Consider the notation 1q=x,2q=x(1),. . . ,mq=x(m−1). (9) Entropy 2020,22, 412 4 of 20 Entropy 2020, 21, x 6 of 20 β ε 0 α ( α max , β min ) ε 1 ε 2 ε m (a) Δ ε i α ε i Δ ε i β β ε m α ( α min , β max ) ε 1 ε i ε 0 (b) Δ ε i α ε 2 Δ ε i β Figure 2. This circuit consists of elements of ε 0 to ε m types, which are located on the common Σ-diagonal. Characteristic quarter-circles are constructed for the (a) current and (b) voltage representation of the circuit. Since the elements are located on the Σ-diagonal, their distances from the hidden element are the same in both the α and β directions; thus, Δ ε i α = Δ ε i β = i. Let us focus on the proof that the formula (18) for the current representation of elements (see Figure 2a) is a Hamiltonian. The proof for the formula (19), which corresponds to the voltage representation, is analogous, so, for the sake of brevity, it will not be given below. The sum (18) for ε ∈ ε 0 is equal to () () 000 00 f xdt f dx S εε ε ε ε εε εε εε ∈∈∈ ==   . (20) For ε ∈ ε m, m > 0, repeated integration by parts leads to the following result: () () ()() () 111 0 11 mm m mjm mmjj j f xdt f x S εε ε ε ε εε εε εε −−− + ∈∈= ∈  =− +−     . (21) Summing for all the circuit elements and rearranging the terms yield the conservative quantity (18) in a compact form: () () ( ) () 1 10 11 ii mm m ji jij jij i x fS εε ε εε εε −− ==∈ =∈  =− + −      . (22) The generalized currents x ε can be represented as linear combinations of generalized loop currents x. Utilizing incidence matrices, the addend of the inner summation of the first term in (22) will assume the form () ( ) () ( ) 11 nn jij j ij k kk k kk ax f x f εε ε −− == =  (23) where kf ε means either ±f ε or 0 depending on whether the element ε is or is not a part of the k-th loop, and, possibly, depending on what its orientation is with regard to this loop. Substituting (23) into (22), expanding the outer series according to index j, and subsequently rearranging the summation yield Figure 2. This circuit consists of elements of ε0 to εm types, which are located on the common Σ -diagonal. Characteristic quarter-circles are constructed for the (a) current and (b) voltage representation of the circuit. Since the elements are located on the Σ -diagonal, their distances from the hidden element are the same in both the αand βdirections; thus, ∆εiα=∆εiβ=i. Assume that the Lagrangian is regular, i.e., det ∂2L ∂x(m) i∂x(m) j ,0, (10) for i,j=1,...,n[19]. In Equation (8), for j=mreads as mp=∂L ∂x(m). (11) Then, the unambiguous relation, x(m)=χ1q,. . . ,mq,mp, (12) can be derived from (11), which enables a transition to new coordinates 1p ,.., mp and 1q ,..., mq and allows us to draw the canonic equations, j. q=∂H ∂jp,j. p=−∂H ∂jq. (13) The Hamiltonian His then a function of the new variables iq,ip,i=1, ... , m: H1q,. . . ,mq,1p,. . . ,mp=1pT·2q+. . . +m−1pT·mq+mpT·χ1q,. . . ,mq,mp−L1q,. . . ,mq,mp(14) where L1q,. . . ,mq,mp=L1q,. . . ,mq,χ1q,. . . ,mq,mp. (15) The procedure of drawing an alternative Hamiltonian for cases when condition (10) of the regularity of the Lagrangian is not fulfilled is described, for example, in [ 19 ]. Irrespective of whether the Lagrangian is or is not regular, the Hamiltonian can be used within Lagrange’s formalism, i.e., in the sense of generalized energy (7). Entropy 2020,22, 412 5 of 20 This formalism, specific to higher-order Hamiltonians of type (14), is denoted Ostrogradsky’s formalism [ 19 ]. None of the hitherto published works deal with assembling the Hamiltonian of systems consisting of elements from Chua’s table. The benefits of using the Hamiltonian have been proven: the system dynamics is given by a set of canonic first-order differential equations, which are the standard starting point for solving complex tasks associated with terms such as the Lyapunov exponents, zero divergence, conservative phase volumes [ 20 ], etc. Hamiltonians are an ideal tool when searching for symmetries and associated conservative quantities [ 21 ]. Today, they are well defined also for systems that have hitherto been considered non-conservative [22]. The objective of this work is therefore to find the Hamiltonian of a Σ -system consisting of arbitrary HOEs within the frame of both Lagrange’s formalism (as generalized energy) and Ostrogradsky’s formalism. The conventional procedure for introducing Ostrogradsky’s formalism into physical theory involves searching for the form of the Lagrangian and generalized momenta, and subsequently obtaining from them a specific form of the Hamiltonian ((7) or (14)). The procedure used in this work will be physically more objective, starting from the generalized Tellegen’s theorem. In addition to its clarity, the reason for selecting this approach is pragmatic: Tellegen’s theorem is extremely general and applicable to circuits of arbitrary topologies with any elements (linear, nonlinear, time-invariant, and time-varying), as well as with arbitrary elements from Chua’s table. Moreover, this theorem can also be formulated via the terminal quantities of individual elements. It is useful for circuits containing HOEs, since the sole fundamental characteristic of the element—the constitutive relation—is a link only between these terminal quantities. Then, the resulting Hamiltonian will naturally be comprised of the constitutive relations of all HOEs in the circuit. This paper has the following structure. Section 2introduces the generalized form of Tellegen’s theorem applicable to circuits with HOEs and thus to circuits with the elements defined via the constitutive relations (1). Section 3is devoted to drawing a specific form of the Hamiltonian for Σ -circuits in the frame of Lagrange’s formalism and also of Ostrogradsky’s formalism. Section 4 describes a modeling technique inspired by Ostrogradsky’s formalism. In the last section, these new pieces of knowledge are applied to a specific topology of the Pais–Uhlenbeck oscillator consisting of HOEs. 2. Tellegen‘s Theorem for Circuits with Higher-Order Elements Consider a circuit comprised of arbitrary one-port elements ε with port voltages v ε and currents iε. Then, the generalized Tellegen’s theorem [23] holds for such a circuit: X ε v(α) εi(β) ε=v(α) εT ·i(β) ε=0 (16) where α and β are arbitrary integers, v(α) ε and i(β) ε are 1xbvectors of generalized voltages and currents of the element, and bis the number of elements in the circuit. The classical form of the theorem, representing the case α = β =0, means that the sum of instantaneous powers delivered to all elements in the circuit is zero. The generalized theorem (16) replaces the instantaneous power [VA] by a quantity [VA] α+β . This is because the integration and differentiation with respect to time belong to Kirchhoff’s operators [ 19 ], which do not affect the validity of Kirchhoff’s laws and the theorems derived from them. Note that the source of the voltage v (α) or current i (β) can be substituted by an ( α , β ) element with a constant constitutive relation (1) of a f() or g() type, so theorem (16) also holds for circuits with voltage and current sources. Consider a circuit comprised of general HOEs. The element εh =( αmax , βmin ) is the hidden element of the current representation of the circuit [ 24 ]. Let us introduce new variables u=v (αmax) and x=i(βmin). Then, Equation (16) can be rewritten with the aid of Equation (1) in the form X ε f(α+αmax−αε) εx(β+βε−βmin) ε=0 (17) Entropy 2020,22, 412 6 of 20 where f ε and x ε are the constitutive relation (1) and the xvariable of the element ε . Since Equation (16) must hold for arbitrary integers α and β , it also holds for α =0 and β =1+ βmin −βε . Substituting these values in formula (17), which is identically equal to zero, and integrating it with respect to time, the resulting quantity must be constant in all circumstances: H=ZX ε f(∆εα) ε . xεdt =const (18) where ∆εα = αmax −αε is the distance of the ε element from the hidden element in the α direction (see Figure 2a). A similar procedure leads to the dual form of Equation (18) for voltage representation of the circuit: H∗=ZX ε g(∆εβ) ε . uεdt =const∗(19) where ∆εβ = βε−βmin is the distance of the ε element from the hidden element εh =( αmin , βmax ) in the βdirection (see Figure 2b). It will be shown in the following section that the quantity (18) or (19) is, for the case of Σ -circuits, a Hamiltonian of type (7) and that it becomes a Hamiltonian of type (14) after transitioning to coordinates that correspond to Ostrogradsky’s formalism. 3. From Tellegen‘s Theorem to the Hamiltonian Let all the elements of the circuit be located on a common Σ -diagonal according to Figure 2. Denote such a circuit as the Σ -circuit. All types of elements will be specified as ε0 to εm , where mis the distance of the εm element from the hidden element in the α or β direction (since the element is located on the Σ -diagonal, these distances are the same, thus ∆εα = ∆εβ = ∆ε ). The method of indexing depends on the position of the hidden element, and this position depends on the choice between the current, f(), and the voltage, g(), representation (1) of the element. The relation ε∈εi ,i=0,...,mwill thus specify that the given εelement is only of the εitype. Let us focus on the proof that the formula (18) for the current representation of elements ( see Figure 2a ) is a Hamiltonian. The proof for the formula (19), which corresponds to the voltage representation, is analogous, so, for the sake of brevity, it will not be given below. The sum (18) for ε∈ε0is equal to X ε∈ε0Zf(0) ε . xεdt =X ε∈ε0Zf(0) εdxε=X ε∈ε0 Sε. (20) For ε∈εm,m>0, repeated integration by parts leads to the following result: X ε∈εmZf(m) ε . xεdt =X ε∈εm m−1 X j=0 (−1)jf(m−1−j) εx(j+1) ε +X ε∈εm (−1)mSε. (21) Summing for all the circuit elements and rearranging the terms yield the conservative quantity (18) in a compact form: H= m X j=1 (−1)j−1 m X i=jX ε∈εi x(j) εf(i−j) ε + m X i=0X ε∈εi (−1)iSε. (22) Entropy 2020,22, 412 7 of 20 The generalized currents x ε can be represented as linear combinations of generalized loop currents x. Utilizing incidence matrices, the addend of the inner summation of the first term in (22) will assume the form n X k=1 aεkx(j) kf(i−j) ε= n X k=1 x(j) k kf(i−j) ε(23) where k f ε means either ± f ε or 0 depending on whether the element ε is or is not a part of the k-th loop, and, possibly, depending on what its orientation is with regard to this loop. Substituting (23) into (22), expanding the outer series according to index j, and subsequently rearranging the summation yield H=n P k=1  x(1) k m X i=1X ε∈εikf(i−1) ε | {z } 1pk +x(2) k m X i=2X ε∈εi−kf(i−2) ε | {z } 2pk +. . . +x(m) kX ε∈εm(−1)m−1kf(0) ε | {z } mpk  − m X i=0X ε∈εi (−1)iSε | {z } L (24) Since it holds that ∂L ∂xk =(−1)k+1kfε, (25) comparing (24) and (7) reveals that the function H from Equation (24) is the generalized energy (7) of the current representation of a circuit with HOEs, and the generalized momenta are jpk=(−1)j−1 m X i=jX ε∈εikf(i−j) ε. (26) The one-dimensional case for n=1 signifies that all the elements are in series, with the common generalized current x. The series connection of the elements of the same type can, therefore, be regarded as one element of the same type, with the constitutive relation given as the sum of constitutive relations of the individual elements. Equation (26) can, therefore, be rewritten in the simplified form jp=(−1)j−1 m X i=j f(i−j) ix(i)(27) where f i () denotes the constitutive relation of an element of the εi type. The generalized momenta are then given as summations of the time derivatives of the constitutive relations 1p=f(0) 1+f(1) 2+ + f(m−1) m 1p=f(0) 1+f(1) 2+ + f(m−1) m . . . mp=(−1)m−1f(0) m. (28) This one-dimensional case clearly illustrates the transition from the formulation of the Hamiltonian (7) to the formulation (14) by changing the coordinates (x (0) ,..., x (m) ) of Lagrange’s formalism to new coordinates ( 1 p,..., m p, 1 q,..., m q) of Ostrogradsky’s formalism. The key relation χ () from (12) can be obtained via a simple inversion of the constitutive relation of the element of the εmtype: mp=(−1)m−1fmx(m)⇒x(m)=gm(−1)m−1mp(29) where gm() is the constitutive relation of the voltage representation of the element of the εmtype. Entropy 2020,22, 412 8 of 20 4. Modeling of the Σ-Circuits Ostrogradsky’s formalism leads to a system of canonic first-order equations (13). This fact facilitates the modeling process. It follows from (28) that the momenta of a one-dimensional system are 1. p=−f01q 2. p=−1p+f12q 3. p=2p+f23q . . . m. p=(−1)m−1m−1p+fm−1(mq). (30) Similarly, the generalized coordinates are 1. q=2q 2. q=3q . . . m−1. q=mq m. q=gm(−1)mmp. (31) The systems of Equations (30) and (31) lead to the elegant programming diagram in Figure 3, consisting of 2xmintegrators for computing mgeneralized momenta and mgeneralized coordinates, as well as m+1 function blocks for modeling the constitutive relations of the individual elements. Entropy 2020, 21, x 8 of 20 () 32 3 2 ppfq=+   () () 11 1 1m mmm m ppfq −− − =− + . Similarly, the generalized coordinates are 12 qq=  23 qq=   1mm qq −=  () () 1m mm m qg p=− . (31) The systems of Equations (30) and (31) lead to the elegant programming diagram in Figure 3, consisting of 2xm integrators for computing m generalized momenta and m generalized coordinates, as well as m+1 function blocks for modeling the constitutive relations of the individual elements.       f m-1 (⋅) f 2 (⋅) f 1 (⋅) f 0 (⋅) g m (⋅) … … ++ + Figure 3. Model of the Σ-system according to Ostrogradsky’s formalism. The color-codes represent the m integrators for computing the iq coordinates and the m integrators for computing the ip momenta. The function blocks model the constitutive relations of individual elements. The gm() block is for modeling the inverse function of fm() according to (29), which enables the transition from Lagrange’s to Ostrogradsky’s formalism. 5. Application: Non-linear Pais–Uhlenbeck Oscillator The usefulness of the Hamiltonian for the analysis of HOE circuits can be demonstrated by the example of the Pais–Uhlenbeck (PU) oscillator [15]. The PU oscillator is frequently employed to test new physical theories. It generates a signal with two harmonic components whose amplitudes and initial phases are given by the initial conditions. Both frequencies are coupled via the formula [25] 114 2 ωω ±− =  (32) where ϵ is a real number, 0 ≤ ϵ < ¼. For ϵ → 0, the PU oscillator changes to a classical sinusoidal oscillator with an oscillation frequency of ω . The PU oscillator is governed by the differential equation 2 20xx x ω ω ++ =   . (33) Figure 3. Model of the Σ -system according to Ostrogradsky’s formalism. The color-codes represent the mintegrators for computing the i qcoordinates and the mintegrators for computing the i pmomenta. The function blocks model the constitutive relations of individual elements. The g m () block is for modeling the inverse function of f m () according to (29), which enables the transition from Lagrange’s to Ostrogradsky’s formalism. 5. Application: Non-Linear Pais–Uhlenbeck Oscillator The usefulness of the Hamiltonian for the analysis of HOE circuits can be demonstrated by the example of the Pais–Uhlenbeck (PU) oscillator [ 15 ]. The PU oscillator is frequently employed to test new physical theories. It generates a signal with two harmonic components whose amplitudes and initial phases are given by the initial conditions. Both frequencies are coupled via the formula [25] ω±=ωs1∓√1−4 2(32) Entropy 2020,22, 412 9 of 20 where  is a real number, 0 ≤ < 1 4 . For → 0, the PU oscillator changes to a classical sinusoidal oscillator with an oscillation frequency of ω. The PU oscillator is governed by the differential equation  ω2 .... x+.. x+ω2x=0. (33) In general, the signal xgenerated by the oscillator is non-periodical. Periodicity is achieved in special cases when the ratio of both frequencies is a rational number. The corresponding values of the constant are as follows: =1 41− 1−k2 1+k2!2,k=ω+ ω−=r s<1 (34) where r,sare integers. Only in these cases will the state-space trajectories be closed curves. It is shown in [ 16 ] that the PU oscillator, modeled by Equation (33), can be implemented as a series or parallel Σ -circuit consisting of an arbitrary triad of HOEs, which are immediate neighbors on an arbitrary Σ -diagonal. One possible combination is shown in the inset in Figure 4a, namely, the series connection of the FDNC,R, and FDNR elements with the constitutive relations f 0 (), f 1 (), and f 2 (). In general, these relations can be nonlinear. The indices 0 to 2 correspond to the distance of the element from the hidden element in the α or β direction. The hidden element is the FDNC. The generalized current xis governed by the differential equation .. f2.. x+. f1. x+f0(x)=0 (35) If all three elements have linear constitutive relations, f0(x)=ω2x,f1. x=. x,f2.. x= ω2 .. x, (36) then the generalized current will be modeled via the linear differential Equation (33). The subsequent analysis is made for linear FDNC and Rand nonlinear FDNR elements with the following constitutive relations: f0(x)=k0x,f1. x=k1 . x,f2.. x=k2arctan.. x. (37) The Lagrangian of the circuit is Lx,. x,.. x=−1 2k0x2+1 2k1 . x2−1 2k22.. xarctan.. x−ln1+.. x2. (38) The equation of motion, generated by the Lagrangian according to (4), takes the form k0x+k1 .. x+k2 .... x1+.. x−... x2 1+.. x2=0. (39) According to (28), the generalized momenta are 1p=k1 . x+k2 ... x 1+.. x2 2p=−k2arctan.. x.(40) For Lagrange’s formalism, the Hamiltonian (7) will be in the form Hx,. x,.. x,... x=1 2k0x2+1 2k1 . x2+k2 . x... x 1+.. x2−1 2k2ln1+.. x2. (41) Entropy 2020,22, 412 16 of 20 Entropy 2020, 21, x 16 of 20 0 20 40 60 80 100 -1.0 -0.5 0.0 0.5 1.0 1.5 Hamiltonian = const Lagrangian Time [s] L, H [Js] 165 nJs Figure 11. Lagrangian and Hamiltonian vs. time. -15m -10m -5m 0m 5m 10m 15m -5m 0m 5m -5m 0m 5m -4m 0m 4m -4m 0m 4m -4m -2m 0m 2m 4m x (2) [As] x (1) [As 2 ] x (0) [As 3 ] x (3) [A] x (2) [As] x (1) [As 2 ] Figure 11. Lagrangian and Hamiltonian vs. time. Entropy 2020, 21, x 16 of 20 0 20 40 60 80 100 -1.0 -0.5 0.0 0.5 1.0 1.5 Hamiltonian = const Lagrangian Time [s] L, H [Js] 165 nJs Figure 11. Lagrangian and Hamiltonian vs. time. -15m -10m -5m 0m 5m 10m 15m -5m 0m 5m -5m 0m 5m -4m 0m 4m -4m 0m 4m -4m -2m 0m 2m 4m x (2) [As] x (1) [As 2 ] x (0) [As 3 ] x (3) [A] x (2) [As] x (1) [As 2 ] Figure 12. Phase trajectories of the PU oscillator with the HP memristor in the coordinates according to Lagrange’s formalism. Entropy 2020,22, 412 17 of 20 Entropy 2020, 21, x 17 of 20 Figure 12. Phase trajectories of the PU oscillator with the HP memristor in the coordinates according to Lagrange’s formalism. -15m -10m -5m 0m 5m 10m 15m -120 0 120 -5m -3m 0m 2m 5m -150 0 150 -120 -60 0 60 120 -150 0 150 1 p [V] 2 q [As 2 ] 1 q [As 3 ] 1 p [V] 2 p [Vs] 2 p [Vs] Figure 13. Phase trajectories of the PU oscillator with the HP memristor in the coordinates according to Ostrogradsky’s formalism. The phase trajectories in Figure 12 and 13 represent the contours of the generalized energy (47) and Hamiltonian (48). They can be discussed the same way as the trajectories in Figs. 8 and 9. 6. Discussion Hamilton’s variational principle, i.e., that the trajectory is the extremal of Lagrange’s function, holds for the Σ-circuits [16]. This work offers new knowledge, namely that a Hamiltonian can be constructed for Σ-circuits and that this Hamiltonian preserves its fixed value during motion. Its physical dimension is given by the number Σ of the diagonal, and its unit is [VAs—Σ]. The Hamiltonian of a circuit consisting of generally nonlinear inductors and capacitors, therefore, represents the energy because both the inductor and capacitor are located on the diagonal with the number Σ = −1. The physical character of the Hamiltonian does not change even if other types of elements from this diagonal appear in the circuit. The work in [9] was the beginning of this type of research. This study introduced the state functions of memristors, memcapacitors, and meminductors and constructed a Lagrangian from those functions. The research in [11,12,16], which appeared later, introduced the conditions for validating Hamilton’s variational principle, building up Hamilton’s formalism, and generalizing all these fundamental pieces of knowledge for general higher-order elements. It was demonstrated in [16] that the higher-order Lagrangian is “native” for general HOEs. Our work offers another insight: For this Lagrangian we construct the corresponding Hamiltonian, which is “native” for circuits with HOEs. In order to derive benefits from Hamilton’s formalism in circuits with HOEs, we should use Ostrogradsky’s formalism because only the higher-order Hamiltonian is native for such circuits. One Figure 13. Phase trajectories of the PU oscillator with the HP memristor in the coordinates according to Ostrogradsky’s formalism. 6. Discussion Hamilton’s variational principle, i.e., that the trajectory is the extremal of Lagrange’s function, holds for the Σ -circuits [ 16 ]. This work offers new knowledge, namely that a Hamiltonian can be constructed for Σ -circuits and that this Hamiltonian preserves its fixed value during motion. Its physical dimension is given by the number Σ of the diagonal, and its unit is [VAs —Σ ]. The Hamiltonian of a circuit consisting of generally nonlinear inductors and capacitors, therefore, represents the energy because both the inductor and capacitor are located on the diagonal with the number Σ = − 1. The physical character of the Hamiltonian does not change even if other types of elements from this diagonal appear in the circuit. The work in [ 9 ] was the beginning of this type of research. This study introduced the state functions of memristors, memcapacitors, and meminductors and constructed a Lagrangian from those functions. The research in [ 11 , 12 , 16 ], which appeared later, introduced the conditions for validating Hamilton’s variational principle, building up Hamilton’s formalism, and generalizing all these fundamental pieces of knowledge for general higher-order elements. It was demonstrated in [ 16 ] that the higher-order Lagrangian is “native” for general HOEs. Our work offers another insight: For this Lagrangian we construct the corresponding Hamiltonian, which is “native” for circuits with HOEs. In order to derive benefits from Hamilton’s formalism in circuits with HOEs, we should use Ostrogradsky’s formalism because only the higher-order Hamiltonian is native for such circuits. One of its advantages is the ability to construct comfortable analyses of the preserved quantities when finding periodical steady states or the conditions of the occurrence of self-oscillation, as demonstrated by the example of the PU oscillator. The synthesis of this circuit via nonlinear HOEs leads to a nonlinear oscillator, which has not been hitherto described in the literature. The Hamiltonian of the PU oscillator consisting of the FDNR,R, and FDNC elements, according to Figure 4a, represents the power because Entropy 2020,22, 412 18 of 20 these elements are located on the diagonal with Σ =0. The Hamiltonian of the PU oscillator consisting of MR,linear FDNC, and linear FDPC elements, according to Figure 4b, represents the action (integral of energy) because these elements are located on the diagonal with Σ = − 2. This quantity is also preserved in the system in spite of the fact that the system is dissipative. Quod nota, the paradox is only illusory because two of the three elements of these specific circuits are, in principle, active elements, namely the FDNR and FDNC or the linear FDNC and linear FDPC elements. The Hamiltonian of the circuit, containing only the HOEs from one diagonal, can be constructed via Equation (24). Equation (24) represents the known structure of a higher-order Hamiltonian, in which the generalized coordinates, generalized momenta, and higher-order Lagrangian appear. The Lagrangian is set up via the constitutive relations of the individual elements. The individual momenta are arranged according to (24) as sums of the generalized voltages of the corresponding orders across selected elements of the circuit. The Lagrangian is given as a sum of the state functions of the individual elements provided with the appropriate sign. The state function of the element corresponds to the area below its constitutive relation. It has been newly found that the state function of the well-known HP memristor with the Joglekar window function for p=1 is a composition of the dilogarithm and the exponential function. The modeling diagram of the one-dimensional Σ -circuit from Figure 3can be generalized in a classical way to a multi-dimensional system (e.g., a circuit with several loops), which can be used for implementation in the corresponding simulation program. For simulation, it is desirable to select a method for numerical integration that is suitable for the analysis of the sets of Hamilton’s differential equations [ 27 ]. The waveform of the Hamiltonian must exhibit negligible deflections from the constant value. This criterion provides a good feedback when seeking for an optimum configuration of the simulation task and parameters, including the time step. The theoretical apparatus built in this work can also be used for circuits conisting only of two types of HOEs immediately neighboring each other on the common Σ -diagonal. However, the Hamiltonian of such a circuit is of a classical not a higher-order type. A typical example is a network of mutually interconnected memcapacitors and meminductors. For researchers dealing with concrete memristive devices, for example the TiO x , TaO x , SiO x , HfO x and other types, it will be useful to determine whether the presented Hamilton’s formalism for higher-order elements can also be applied to these devices. It follows from the essence of the given formalism that this formalism can be used only for circuits that are made up of two-terminal HOEs, whereas all the HOEs from the circuit must be located on the common Σ -diagonal of Chua’s table. The question is whether the models of these memristive systems can be built from the above HOEs and whether all the other elements from the circuit are also located on the common diagonal. Historically, the first model of the HP memristor with a simple window function [ 7 , 28 ] for modeling the nonlinear dopant drift can be classified as an ideal generic memristor. Since this memristor is equivalent to an ideal memristor, it can be considered an HOE of the ( − 1, − 1) type, which complies with Hamilton’s formalism. However, the corresponding application circuit must contain, in addition to this memristor, only the other appropriate HOEs from the Σ = − 2 diagonal—for example, ( − 2, 0), ( 0, −2 ) and other elements. If some of these elements are linear, then they can be moved in Chua’s table along the corresponding ∆ -diagonals [ 31 ]. Then, the set of these admissible linear elements will grow, as is illustrated in Section 5. However, the complex physical models of the above mentioned memristive devices, such as the Tunneling barrier model, TEAM, and others [ 32 ], are classified as extended memristors, which cannot be generally built from two-terminal HOEs. Thus, attempts to utilize the presented Hamilton’s formalism for such systems interfere with the principal limits. When looking for a Hamilton’s formalism suitable for these elements, it will be necessary to use other methods, such as those mentioned, for example, in [21,22]. Entropy 2020,22, 412 19 of 20 Author Contributions: Conceptualization, Z.B., D.B., V.B., and Z.K.; methodology, D.B.; writing—original draft preparation, Z.B.; writing—review and editing, Z.B., D.B., V.B., and Z.K.; project administration and funding acquisition, V.B. and Z.K. All authors have read and approved the final manuscript. Funding: This work was supported by the Czech Science Foundation under grant no. 18-21608S. For the research, the infrastructure of K217 Department, UD Brno, was also used. The APC was funded by the Open Access Fund of Brno University of Technology. Conflicts of Interest: The authors declare no conflict of interest. References 1. Fuchs, A. Nonlinear Dynamics in Complex Systems; Springer: Berlin/Heidelberg, Germany, 2013. [CrossRef] 2. Chua, L.O. CNN: A Paradigm for Complexity; World Scientific Series on Nonlinear Science Series A; World Scientific: Singapore, 1998; Volume 31. 3. Caravelli, F.; Traversa, F.L.; Di Ventra, M. Complex dynamics of memristive circuits: Analytical results and universal slow relaxation. Phys. Rev. 2017,E95, 022140. [CrossRef] 4. Di Ventra, M.; Traversa, F.L. Absence of chaos in digital memcomputing machines with solutions. Phys. Lett. A 2017,381, 3255–3257. [CrossRef] 5. Chua, L.O. Device modeling via nonlinear circuit elements. IEEE Trans. Circuits Syst. 1980 ,27, 1014–1044. [CrossRef] 6. Chua, L.O. Memristor—The missing circuit element. IEEE Trans. Circuit Theory 1971 ,18, 507–519. [CrossRef] 7. Strukov, D.B.; Snider, G.S.; Stewart, D.R.; Williams, R.S. The missing memristor found. Nature 2008 ,453, 80–83. [CrossRef] [PubMed] 8. Biolek, D.; Biolek, Z.; Biolkov á , V. Every nonlinear element from Chua’s table can generate pinched hysteresis loops: Generalised homothety theorem. Electron. Lett. 2016,52, 1744–1746. [CrossRef] 9. Jeltsema, D. Memory Elements: A Paradigm Shift in Lagrangian Modeling of Electrical Circuits. IFAC Proc. Vol. 2012,45, 445–450. [CrossRef] 10. Cohen, G.Z.; Pershin, Y.V.; Di Ventra, M. Lagrange Formalism of Memory Circuit Elements: Classical and Quantum Formulations. Phys. Rev. B 2012,85, 165428–165430. [CrossRef] 11. Biolek, Z.; Biolek, D.; Biolkov á , V. Utilization of Euler-Lagrange Equations in Circuits with Memory Elements. Radioengineering 2016,25, 783–789. [CrossRef] 12. Biolek, Z.; Biolek, D.; Biolkov á , V. Euler-Lagrange Equations of Networks with Higher-Order Elements. Radioengineering 2017,26, 397–405. [CrossRef] 13. Millar, W. Some general theorems for nonlinear systems possessing resistance. Philos. Mag. 1951 ,42, 1150–1160. [CrossRef] 14. Cherry, E.C. Some general theorems for nonlinear systems possessing reactance. Philos. Mag. 1951 ,42, 1161–1177. [CrossRef] 15. Pais, A.; Uhlenbeck, G.E. On Field Theories with Non-Localized Action. Phys. Rev. 1950 ,79, 145–165. [CrossRef] 16. Biolek, D.; Biolek, Z.; Biolkov á , V. Lagrangian for Circuits with Higher-Order Elements. Entropy 2019 ,21, 1059. [CrossRef] 17. Ostrogradsky, M. M é moire sur les deff é rentielles relatives aux problemes des isop é rimetres. Mem. Acad. Sci. St. Petersb. 1850,6, 385–517. 18. Lanczos, C. The Variational Principles of Mechanics, 4th ed.; Dover Books on Physics (Book 4); Dover Publications: Mineola, NY, USA, 1986. 19. Knetter, C.G. Effective Lagrangians with higher derivatives and equations of motion. Phys. Rev. D 1994 ,49, 6709. [CrossRef] 20. Deng, Y.; Li, Y. A memristive conservative chaotic circuit consisting of a memristor and capacitor. Chaos 2020 , 30, 013120. [CrossRef] 21. Itoh, M.; Chua, L.O. Memristor Hamiltonian Circuits. Int. J. Bif. Chaos 2011,21, 2395–24255. [CrossRef] 22. Itoh, M.; Chua, L.O. Dynamics of Hamiltonian Systems and Memristor Circuits. Int. J. Bif. Chaos 2017 ,27, 1730005. [CrossRef] 23. Penfield, P.; Spence, R.; Duinker, S. A generalized form of Tellegen’s theorem. IEEE Trans. Circuit Theory 1970,17, 302–305. [CrossRef] Entropy 2020,22, 412 20 of 20 24. Biolek, Z.; Biolek, D.; Biolkov á , V.; Kolka, Z. Taxicab Geometry in Table of Higher-Order Elements. Nonlinear Dyn. 2019,98, 623–636. [CrossRef] 25. Woodard, R.P. The Theorem of Ostrogradsky. arXiv 2015, arXiv:1506.02210. 26. Soliman, A.M. Realizations of ideal FDNC and FDNR elements using new types of mutators. Int. J. Electron. 1978,44, 317–323. [CrossRef] 27. Barbu, A.; Zhu, S.-C. Monte Carlo Methods, 4th ed.; Springer: Singapore, 2020; p. 422. [CrossRef] 28. Joglekar, Y.N.; Wolf, S.J. The elusive memristor: Properties of basic electrical circuits. Eur. J. Phys. 2009 ,30, 661–675. [CrossRef] 29. Biolek, Z.; Biolek, D. Fourth Fundamental Circuit Element: SPICE Modeling and Simulation. In Memristor and Memristive Systems; Springer: New York, NY, USA, 2014; pp. 105–162. [CrossRef] 30. Lewin, L. Dilogarithms and Associated Functions, 1st ed.; MacDonald: London, UK, 1958; p. 353. 31. Biolek, D.; Biolek, Z.; Biolkov á , V. Duality of Complex Systems Built from Higher-Order Elements. Complexity 2018,2018, 15. [CrossRef] 32. Ascoli, A.; Corinto, F.; Senger, V.; Tetzlaff, R. Memristor Model Comparison. IEEE Circuits Syst. Mag. 2013 , 13, 89–105. [CrossRef] © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).