The success of today's large language models (LLMs) depends on the observation that larger models perform better. However, the origin of this neural scaling law, that loss decreases as a power law with model size, remains unclear. We propose that representation superposition, meaning that LLMs represent more features than they have dimensions, can be a key contributor to loss and cause neural scaling. Based on Anthropic's toy model, we use weight decay to control the degree of superposition, allowing us to systematically study how loss scales with model size. When superposition is weak, the loss follows a power law only if data feature frequencies are power-law distributed. In contrast, under strong superposition, the loss generically scales inversely with model dimension across a broad class of frequency distributions, due to geometric overlaps between representation vectors. We confirmed that open-sourced LLMs operate in the strong superposition regime and have loss scaling inversely with model dimension, and that the Chinchilla scaling laws are also consistent with this behavior. Our results identify representation superposition as a central driver of neural scaling laws, providing insights into questions like when neural scaling laws can be improved and when they will break down. <<<

The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration. The best performing models also connect the encoder and decoder through an attention mechanism. We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely. Experiments on two machine translation tasks show these models to be superior in quality while being more parallelizable and requiring significantly less time to train. Our model achieves 28.4 BLEU on the WMT 2014 English-to-German translation task, improving over the existing best results, including ensembles by over 2 BLEU. On the WMT 2014 English-to-French translation task, our model establishes a new single-model state-of-the-art BLEU score of 41.8 after training for 3.5 days on eight GPUs, a small fraction of the training costs of the best models from the literature. We show that the Transformer generalizes well to other tasks by applying it successfully to English constituency parsing both with large and limited training data. <<<

Mingfei Chen, Yifan Wang, Zhengqin Li, Homanga Bharadhwaj, Yujin Chen, Chuan Qin, Ziyi Kou, Yuan Tian, Eric Whitmire, Rajinder Sodhi, Hrvoje Benko, Eli Shlizerman, Yue Liu <<<

Prior works on 3D hand trajectory prediction are constrained by datasets that decouple motion from semantic supervision and by models that weakly link reasoning and action. To address these, we first present the EgoMAN dataset, a large-scale egocentric dataset for interaction stage-aware 3D hand trajectory prediction with 219K 6DoF trajectories and 3M structured QA pairs for semantic, spatial, and motion reasoning. We then introduce the EgoMAN model, a reasoning-to-motion framework that links vision-language reasoning and motion generation via a trajectory-token interface. Trained progressively to align reasoning with motion dynamics, our approach yields accurate and stage-aware trajectories with generalization across real-world scenes. <<<

Few classical games have been regarded as such significant benchmarks of artificial intelligence as to have justified training costs in the millions of dollars. Among these, Stratego -- a board wargame exemplifying the challenge of strategic decision making under massive amounts of hidden information -- stands apart as a case where such efforts failed to produce performance at the level of top humans. This work establishes a step change in both performance and cost for Stratego, showing that it is now possible not only to reach the level of top humans, but to achieve vastly superhuman level -- and that doing so requires not an industrial budget, but merely a few thousand dollars. We achieved this result by developing general approaches for self-play reinforcement learning and test-time search under imperfect information. <<<

Position encoding recently has shown effective in the transformer architecture. It enables valuable supervision for dependency modeling between elements at different positions of the sequence. In this paper, we first investigate various methods to integrate positional information into the learning process of transformer-based language models. Then, we propose a novel method named Rotary Position Embedding(RoPE) to effectively leverage the positional information. Specifically, the proposed RoPE encodes the absolute position with a rotation matrix and meanwhile incorporates the explicit relative position dependency in self-attention formulation. Notably, RoPE enables valuable properties, including the flexibility of sequence length, decaying inter-token dependency with increasing relative distances, and the capability of equipping the linear self-attention with relative position encoding. Finally, we evaluate the enhanced transformer with rotary position embedding, also called RoFormer, on various long text classification benchmark datasets. Our experiments show that it consistently overcomes its alternatives. Furthermore, we provide a theoretical analysis to explain some experimental results. RoFormer is already integrated into Huggingface: \url{https://huggingface.co/docs/transformers/model_doc/roformer}. <<<

An autonomous robotic nut tightening system for a serial manipulator equipped with a parallel gripper is proposed. The system features a hierarchical motion-primitive-based planner and a control-switching scheme that alternates between force and position control. Extensive simulations demonstrate the system's robustness to variance in initial conditions. Additionally, the proposed controller tightens threaded screws 14% faster than the baseline while applying 40 times less contact force on manipulands. For the benefit of the research community, the system's implementation is open-sourced. <<<

Xidong Feng, Vivek Veeriah, Marcus Chiam, Michael Dennis, Ryan Pachauri, Thomas Tumiel, Federico Barbero, Johan Obando-Ceron, Jiaxin Shi, Satinder Singh, Shaobo Hou, Nenad Tomašev, Tom Zahavy <<<

While Generative AI rapidly advances in various domains, generating truly creative, aesthetic, and counter-intuitive outputs remains a challenge. This paper presents an approach to tackle these difficulties in the domain of chess puzzles. We start by benchmarking Generative AI architectures, and then introduce an RL framework with novel rewards based on chess engine search statistics to overcome some of those shortcomings. The rewards are designed to enhance a puzzle's uniqueness, counter-intuitiveness, diversity, and realism. Our RL approach dramatically increases counter-intuitive puzzle generation by 10x, from 0.22\% (supervised) to 2.5\%, surpassing existing dataset rates (2.1\%) and the best Lichess-trained model (0.4\%). Our puzzles meet novelty and diversity benchmarks, retain aesthetic themes, and are rated by human experts as more creative, enjoyable, and counter-intuitive than composed book puzzles, even approaching classic compositions. Our final outcome is a curated booklet of these AI-generated puzzles, which is acknowledged for creativity by three world-renowned experts. <<<

Variational quantum algorithms (VQAs) are leading strategies to reachpractical utilities of near-term quantum devices. However, the no-cloningtheorem in quantum mechanics precludes standard backpropagation, leading toprohibitive quantum resource costs when applying VQAs to large-scale tasks. Toaddress this challenge, we reformulate the training dynamics of VQAs as anonlinear partial differential equation and propose a novel protocol thatleverages physics-informed neural networks (PINNs) to model this dynamicalsystem efficiently. Given a small amount of training trajectory data collectedfrom quantum devices, our protocol predicts the parameter updates of VQAs overmultiple iterations on the classical side, dramatically reducing quantumresource costs. Through systematic numerical experiments, we demonstrate thatour method achieves up to a 30x speedup compared to conventional methods andreduces quantum resource costs by as much as 90\% for tasks involving up to 40qubits, including ground state preparation of different quantum systems, whilemaintaining competitive accuracy. Our approach complements existing techniquesaimed at improving the efficiency of VQAs and further strengthens theirpotential for practical applications. <<<

Shuanghao Bai, Wenxuan Song, Jiayi Chen, Yuheng Ji, Zhide Zhong, Jin Yang, Han Zhao, Wanqi Zhou, Wei Zhao, Zhe Li, Pengxiang Ding, Cheng Chi, Haoang Li, Chang Xu, Xiaolong Zheng, Donglin Wang, Shanghang Zhang, Badong Chen <<<

Embodied intelligence has witnessed remarkable progress in recent years,driven by advances in computer vision, natural language processing, and therise of large-scale multimodal models. Among its core challenges, robotmanipulation stands out as a fundamental yet intricate problem, requiring theseamless integration of perception, planning, and control to enable interactionwithin diverse and unstructured environments. This survey presents acomprehensive overview of robotic manipulation, encompassing foundationalbackground, task-organized benchmarks and datasets, and a unified taxonomy ofexisting methods. We extend the classical division between high-level planningand low-level control by broadening high-level planning to include language,code, motion, affordance, and 3D representations, while introducing a newtaxonomy of low-level learning-based control grounded in training paradigmssuch as input modeling, latent learning, and policy learning. Furthermore, weprovide the first dedicated taxonomy of key bottlenecks, focusing on datacollection, utilization, and generalization, and conclude with an extensivereview of real-world applications. Compared with prior surveys, our work offersboth a broader scope and deeper insight, serving as an accessible roadmap fornewcomers and a structured reference for experienced researchers. All relatedresources, including research papers, open-source datasets, and projects, arecurated for the community athttps://github.com/BaiShuanghao/Awesome-Robotics-Manipulation. <<<

Frontier reasoning models have exhibited incredible capabilities across awide array of disciplines, driven by posttraining large language models (LLMs)with reinforcement learning (RL). However, despite the widespread success ofthis paradigm, much of the literature has been devoted to disentangling trulynovel behaviors that emerge during RL but are not present in the base models.In our work, we approach this question from a different angle, instead askingwhether comparable reasoning capabilites can be elicited from base models atinference time by pure sampling, without any additional training. Inspired byMarkov chain Monte Carlo (MCMC) techniques for sampling from sharpeneddistributions, we propose a simple iterative sampling algorithm leveraging thebase models' own likelihoods. Over different base models, we show that ouralgorithm offers substantial boosts in reasoning that nearly match and evenoutperform those from RL on a wide variety of single-shot tasks, includingMATH500, HumanEval, and GPQA. Moreover, our sampler avoids the collapse indiversity over multiple samples that is characteristic of RL-posttraining.Crucially, our method does not require training, curated datasets, or averifier, suggesting broad applicability beyond easily verifiable domains. <<<

2048 is a stochastic single-player game involving 16 cells on a 4 by 4 grid,where a player chooses a direction among up, down, left, and right to obtain ascore by merging two tiles with the same number located in neighboring cellsalong the chosen direction. This paper presents that a variant 2048-4x3 12cells on a 4 by 3 board, one row smaller than the original, has been stronglysolved. In this variant, the expected score achieved by an optimal strategy isabout $50724.26$ for the most common initial states: ones with two tiles ofnumber 2. The numbers of reachable states and afterstates are identified to be$1,152,817,492,752$ and $739,648,886,170$, respectively. The key technique isto partition state space by the sum of tile numbers on a board, which we callthe age of a state. An age is invariant between a state and its successiveafterstate after any valid action and is increased two or four by stochasticresponse from the environment. Therefore, we can partition state space by agesand enumerate all (after)states of an age depending only on states with therecent ages. Similarly, we can identify (after)state values by going along withages in decreasing order. <<<

Runnan Fang, Shihao Cai, Baixuan Li, Jialong Wu, Guangyu Li, Wenbiao Yin, Xinyu Wang, Xiaobin Wang, Liangcai Su, Zhen Zhang, Shibin Wu, Zhengwei Tao, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou <<<

Advanced agentic intelligence is a prerequisite for deploying Large LanguageModels in practical, real-world applications. Diverse real-world APIs demandprecise, robust function-calling intelligence, which needs agents to developthese capabilities through interaction in varied environments. The breadth offunction-calling competence is closely tied to the diversity of environments inwhich agents are trained. In this work, we scale up environments as a steptowards advancing general agentic intelligence. This gives rise to two centralchallenges: (i) how to scale environments in a principled manner, and (ii) howto effectively train agentic capabilities from experiences derived throughinteractions with these environments. To address these, we design a scalableframework that automatically constructs heterogeneous environments that arefully simulated, systematically broadening the space of function-callingscenarios. We further adapt a two-phase agent fine-tuning strategy: firstendowing agents with fundamental agentic capabilities, then specializing themfor domain-specific contexts. Extensive experiments on agentic benchmarks,tau-bench, tau2-Bench, and ACEBench, demonstrate that our trained model,AgentScaler, significantly enhances the function-calling capability of models. <<<

Giovanni Acampora, Andris Ambainis, Natalia Ares, Leonardo Banchi, Pallavi Bhardwaj, Daniele Binosi, G. Andrew D. Briggs, Tommaso Calarco, Vedran Dunjko, Jens Eisert, Olivier Ezratty, Paul Erker, Federico Fedele, Elies Gil-Fuster, Martin Gärttner, Mats Granath, Markus Heyl, Iordanis Kerenidis, Matthias Klusch, Anton Frisk Kockum, Richard Kueng, Mario Krenn, Jörg Lässig, Antonio Macaluso, Sabrina Maniscalco, Florian Marquardt, Kristel Michielsen, Gorka Muñoz-Gil, Daniel Müssig, Hendrik Poulsen Nautrup, Sophie A. Neubauer, Evert van Nieuwenburg, Roman Orus, Jörg Schmiedmayer, Markus Schmitt, Philipp Slusallek, Filippo Vicentini, Christof Weitenberg, Frank K. Wilhelm <<<

This white paper discusses and explores the various points of intersectionbetween quantum computing and artificial intelligence (AI). It describes howquantum computing could support the development of innovative AI solutions. Italso examines use cases of classical AI that can empower research anddevelopment in quantum technologies, with a focus on quantum computing andquantum sensing. The purpose of this white paper is to provide a long-termresearch agenda aimed at addressing foundational questions about how AI andquantum computing interact and benefit one another. It concludes with a set ofrecommendations and challenges, including how to orchestrate the proposedtheoretical work, align quantum AI developments with quantum hardware roadmaps,estimate both classical and quantum resources - especially with the goal ofmitigating and optimizing energy consumption - advance this emerging hybridsoftware engineering discipline, and enhance European industrialcompetitiveness while considering societal implications. <<<

The International Mathematical Olympiad (IMO) poses uniquely challengingproblems requiring deep insight, creativity, and formal reasoning. While LargeLanguage Models (LLMs) perform well on mathematical benchmarks like AIME, theystruggle with Olympiad-level tasks. We use Google's Gemini 2.5 Pro on the newlyreleased IMO 2025 problems, avoiding data contamination. Using aself-verification pipeline with careful prompt design, 5 (out of 6) problemsare solved correctly. This result underscores the importance of developingoptimal strategies to harness the full potential of powerful LLMs for complexreasoning tasks. <<<

Large Language Models (LLMs) have demonstrated strong capabilities but remain fundamentally static, unable to adapt their internal parameters to novel tasks, evolving knowledge domains, or dynamic interaction contexts. As LLMs are increasingly deployed in open-ended, interactive environments, this static nature has become a critical bottleneck, necessitating agents that can adaptively reason, act, and evolve in real time. This paradigm shift -- from scaling static models to developing self-evolving agents -- has sparked growing interest in architectures and methods enabling continual learning and adaptation from data, interactions, and experiences. This survey provides the first systematic and comprehensive review of self-evolving agents, organized around three foundational dimensions -- what to evolve, when to evolve, and how to evolve. We examine evolutionary mechanisms across agent components (e.g., models, memory, tools, architecture), categorize adaptation methods by stages (e.g., intra-test-time, inter-test-time), and analyze the algorithmic and architectural designs that guide evolutionary adaptation (e.g., scalar rewards, textual feedback, single-agent and multi-agent systems). Additionally, we analyze evaluation metrics and benchmarks tailored for self-evolving agents, highlight applications in domains such as coding, education, and healthcare, and identify critical challenges and research directions in safety, scalability, and co-evolutionary dynamics. By providing a structured framework for understanding and designing self-evolving agents, this survey establishes a roadmap for advancing adaptive agentic systems in both research and real-world deployments, ultimately shedding lights to pave the way for the realization of Artificial Super Intelligence (ASI), where agents evolve autonomously, performing at or beyond human-level intelligence across a wide array of tasks. <<<

This paper introduces Genesis, the first compiler designed to supportHamiltonian Simulation on hybrid continuous-variable (CV) and discrete-variable(DV) quantum computing systems. Genesis is a two-level compilation system. Atthe first level, it decomposes an input Hamiltonian into basis gates using thenative instruction set of the target hybrid CV-DV quantum computer. At thesecond level, it tackles the mapping and routing of qumodes/qubits to implementlong-range interactions for the gates decomposed from the first level. Ratherthan a typical implementation that relies on SWAP primitives similar toqubit-based (or DV-only) systems, we propose an integrated design ofconnectivity-aware gate synthesis and beamsplitter SWAP insertion tailored forhybrid CV-DV systems. We also introduce an OpenQASM-like domain-specificlanguage (DSL) named CVDV-QASM to represent Hamiltonian in terms ofPauli-exponentials and basic gate sequences from the hybrid CV-DV gate set.Genesis has successfully compiled several important Hamiltonians, including theBose-Hubbard model, $\mathbb{Z}_2-$Higgs model, Hubbard-Holstein model,Heisenberg model and Electron-vibration coupling Hamiltonians, which arecritical in domains like quantum field theory, condensed matter physics, andquantum chemistry. Our implementation is available atGenesis-CVDV-Compiler(https://github.com/ruadapt/Genesis-CVDV-Compiler). <<<

We construct $\varepsilon$-approximate unitary $k$-designs on $n$ qubits incircuit depth $O(\log k \log \log n k / \varepsilon)$. The depth isexponentially improved over all known results in all three parameters $n$, $k$,$\varepsilon$. We further show that each dependence is optimal up toexponentially smaller factors. Our construction uses $\tilde{{O}}(nk)$ ancillaqubits and ${O}(nk)$ bits of randomness, which are also optimal up to $\log(nk)$ factors. An alternative construction achieves a smaller ancilla count$\tilde{{O}}(n)$ with circuit depth ${O}(k \log \log nk/\varepsilon)$. Toachieve these efficient unitary designs, we introduce a highly-structuredrandom unitary ensemble that leverages long-range two-qubit gates and low-depthimplementations of random classical hash functions. We also develop a newanalytical framework for bounding errors in quantum experiments involving manyqueries to random unitaries. As an illustration of this framework'sversatility, we provide a succinct alternative proof of the existence ofpseudorandom unitaries. <<<

A major challenge in the burgeoning field of quantum simulation forhigh-energy physics is the realization of scalable $2+1$D lattice gaugetheories on state-of-the-art quantum hardware, which is an essential steptowards the overarching goal of probing $3+1$D quantum chromodynamics on aquantum computer. Despite great progress, current experimental implementationsof $2+1$D lattice gauge theories are mostly restricted to relatively smallsystem sizes and two-level representations of the gauge and electric fields.Here, we propose a resource-efficient method for quantum simulating $2+1$Dspin-$S$ $\mathrm{U}(1)$ quantum link lattice gauge theories with dynamicalmatter using qudit-based quantum processors. By integrating out the matterfields through Gauss's law, we reformulate the quantum link model in a purelyspin picture compatible with qudit encoding across arbitrary spatialdimensions, eliminating the need for ancillary qubits and reducing resourceoverhead. Focusing first on the spin-$1/2$ case, we construct explicit circuitsfor the full Hamiltonian and demonstrate through numerical simulations that thefirst-order Trotterized circuits accurately capture the quench dynamics even inthe presence of realistic noise levels. Additionally, we introduce a generalmethod for constructing coupling-term circuits for higher-spin representations$S>1/2$. Compared to conventional qubit encodings, our framework significantlyreduces the number of quantum resources and gate count. Our approachsignificantly enhances scalability and fidelity for probing nonequilibriumphenomena in higher-dimensional lattice gauge theories, and is readily amenableto implementation on state-of-the-art qudit platforms. <<<