-
Recurrent Action Transformer with Memory
Authors:
Alexey Staroverov,
Egor Cherepanov,
Dmitry Yudin,
Alexey K. Kovalev,
Aleksandr I. Panov
Abstract:
Recently, the use of transformers in offline reinforcement learning has become a rapidly developing area. This is due to their ability to treat the agent's trajectory in the environment as a sequence, thereby reducing the policy learning problem to sequence modeling. In environments where the agent's decisions depend on past events, it is essential to capture both the event itself and the decision…
▽ More
Recently, the use of transformers in offline reinforcement learning has become a rapidly developing area. This is due to their ability to treat the agent's trajectory in the environment as a sequence, thereby reducing the policy learning problem to sequence modeling. In environments where the agent's decisions depend on past events, it is essential to capture both the event itself and the decision point in the context of the model. However, the quadratic complexity of the attention mechanism limits the potential for context expansion. One solution to this problem is to enhance transformers with memory mechanisms. In this paper, we propose the Recurrent Action Transformer with Memory (RATE) - a model that incorporates recurrent memory. To evaluate our model, we conducted extensive experiments on both memory-intensive environments (VizDoom-Two-Color, T-Maze) and classic Atari games and MuJoCo control environments. The results show that the use of memory can significantly improve performance in memory-intensive environments while maintaining or improving results in classic environments. We hope that our findings will stimulate research on memory mechanisms for transformers applicable to offline reinforcement learning.
△ Less
Submitted 27 March, 2024; v1 submitted 15 June, 2023;
originally announced June 2023.
-
Critical temperature for the nuclear liquid-gas phase transition (from multifragmentation and fission)
Authors:
V. A. Karnaukhov,
H. Oeschler,
A. Budzanowski,
S. P. Avdeyev,
A. S. Botvina,
E. A. Cherepanov,
W. Karcz,
V. V. Kirakosyan,
P. A. Rukoyatkin,
I. Skwirczynska,
E. Norbeck
Abstract:
Critical temperature Tc for the nuclear liquid-gas phase transition is stimated both from the multifragmentation and fission data. In the first case,the critical temperature is obtained by analysis of the IMF yields in p(8.1 GeV)+Au collisions within the statistical model of multifragmentation (SMM). In the second case, the experimental fission probability for excited 188Os is compared with the…
▽ More
Critical temperature Tc for the nuclear liquid-gas phase transition is stimated both from the multifragmentation and fission data. In the first case,the critical temperature is obtained by analysis of the IMF yields in p(8.1 GeV)+Au collisions within the statistical model of multifragmentation (SMM). In the second case, the experimental fission probability for excited 188Os is compared with the calculated one with Tc as a free parameter. It is concluded for both cases that the critical temperature is higher than 16 MeV.
△ Less
Submitted 29 January, 2008;
originally announced January 2008.
-
Fission and Nuclear Liquid-Gas Phase Transition
Authors:
E. A. Cherepanov,
V. A. Karnaukhov
Abstract:
The temperature dependence of the liquid-drop fission barrier is considered, the critical temperature for the liquid-gas phase transition in nuclear matter being a parameter. Experimental and calculated data on the fission probability are compared for highly excited $^{188}$Os. The calculations have been made in the framework of the statistical model. It is concluded that the critical temperatur…
▽ More
The temperature dependence of the liquid-drop fission barrier is considered, the critical temperature for the liquid-gas phase transition in nuclear matter being a parameter. Experimental and calculated data on the fission probability are compared for highly excited $^{188}$Os. The calculations have been made in the framework of the statistical model. It is concluded that the critical temperature for the nuclear liquid--gas phase transition is higher than 16 MeV.
△ Less
Submitted 30 March, 2007;
originally announced March 2007.
-
Reaction 48Ca+208Pb: the capture-fission cross-sections and the mass-energy distributions of fragments above and deep below the Coulomb barrier
Authors:
E. V. Prokhorova,
E. A. Cherepanov,
M. G. Itkis,
N. A. Kondratiev,
E. M. Kozulin,
L. Krupa,
Yu. Ts. Oganessian,
V. V. Pashkevich,
I. V. Pokrovsky,
A. Ya. Rusanov
Abstract:
The capture-fission cross-sections in an energy range of 206-242 MeV of 48Ca-projectiles and mass-energy distributions (MEDs) of reaction products in an energy range of 211-242 MeV have been measured in the 48Ca+208Pb reaction using the double-arm time-of-flight spectrometer CORSET. The MEDs of fragments for heated fission were shown to consist of two components. One component, which is due to c…
▽ More
The capture-fission cross-sections in an energy range of 206-242 MeV of 48Ca-projectiles and mass-energy distributions (MEDs) of reaction products in an energy range of 211-242 MeV have been measured in the 48Ca+208Pb reaction using the double-arm time-of-flight spectrometer CORSET. The MEDs of fragments for heated fission were shown to consist of two components. One component, which is due to classical fusion-fission, is associated with the symmetric fission of the 256No compound nucleus. The other component, which appears as ''shoulders'', is associated with the quasi-fission process and can be named ''quasi-fission shoulders''. Those quasi-fission shoulders enclose light fragments whose masses are 60-90 a.m.u. The total kinetic energy (TKE) of the fragments that belong to the shoulders is higher than the value expected for a classical fusion-fission process. We have come to the conclusion that in quasi-fission, spherical shells with Z=28 and N=50 play a great role. It has also been demonstrated that the properties of the MEDs of fragments formally agree with a well-known hypothesis of two independent fission modes; in this case the modes are normal fusion-fission and quasi-fission processes. A high-energetic Super-Short mode of classical fission has been found at low excitation energies in the mass range of heavy fragments M = 130-135 and TKE = 233 MeV; however the yield associated with this mode is small.
△ Less
Submitted 29 September, 2003;
originally announced September 2003.
-
Dinuclear concept - cluster model of fusion
Authors:
G. G. Adamian,
N. V. Antonenko,
E. A. Cherepanov,
A. K. Nasirov,
W. Scheid,
V. V. Volkov
Abstract:
The synthesis of superheavy elements is analysed within the dinuclear system concept of compound nucleus formation. The perspectives for using radioactive beams in complete fusion reactions are discussed.
The synthesis of superheavy elements is analysed within the dinuclear system concept of compound nucleus formation. The perspectives for using radioactive beams in complete fusion reactions are discussed.
△ Less
Submitted 2 November, 1999;
originally announced November 1999.
