Position encoding recently has shown effective in the transformer architecture. It enables valuable supervision for dependency modeling between elements at different positions of the sequence. In this paper, we first investigate various methods to integrate positional information into the learning process of transformer-based language models. Then, we propose a novel method named Rotary Position Embedding(RoPE) to effectively leverage the positional information. Specifically, the proposed RoPE encodes the absolute position with a rotation matrix and meanwhile incorporates the explicit relative position dependency in self-attention formulation. Notably, RoPE enables valuable properties, including the flexibility of sequence length, decaying inter-token dependency with increasing relative distances, and the capability of equipping the linear self-attention with relative position encoding. Finally, we evaluate the enhanced transformer with rotary position embedding, also called RoFormer, on various long text classification benchmark datasets. Our experiments show that it consistently overcomes its alternatives. Furthermore, we provide a theoretical analysis to explain some experimental results. RoFormer is already integrated into Huggingface: \url{https://huggingface.co/docs/transformers/model_doc/roformer}. <<<

An autonomous robotic nut tightening system for a serial manipulator equipped with a parallel gripper is proposed. The system features a hierarchical motion-primitive-based planner and a control-switching scheme that alternates between force and position control. Extensive simulations demonstrate the system's robustness to variance in initial conditions. Additionally, the proposed controller tightens threaded screws 14% faster than the baseline while applying 40 times less contact force on manipulands. For the benefit of the research community, the system's implementation is open-sourced. <<<

Xidong Feng, Vivek Veeriah, Marcus Chiam, Michael Dennis, Ryan Pachauri, Thomas Tumiel, Federico Barbero, Johan Obando-Ceron, Jiaxin Shi, Satinder Singh, Shaobo Hou, Nenad Tomašev, Tom Zahavy <<<

While Generative AI rapidly advances in various domains, generating truly creative, aesthetic, and counter-intuitive outputs remains a challenge. This paper presents an approach to tackle these difficulties in the domain of chess puzzles. We start by benchmarking Generative AI architectures, and then introduce an RL framework with novel rewards based on chess engine search statistics to overcome some of those shortcomings. The rewards are designed to enhance a puzzle's uniqueness, counter-intuitiveness, diversity, and realism. Our RL approach dramatically increases counter-intuitive puzzle generation by 10x, from 0.22\% (supervised) to 2.5\%, surpassing existing dataset rates (2.1\%) and the best Lichess-trained model (0.4\%). Our puzzles meet novelty and diversity benchmarks, retain aesthetic themes, and are rated by human experts as more creative, enjoyable, and counter-intuitive than composed book puzzles, even approaching classic compositions. Our final outcome is a curated booklet of these AI-generated puzzles, which is acknowledged for creativity by three world-renowned experts. <<<

Variational quantum algorithms (VQAs) are leading strategies to reachpractical utilities of near-term quantum devices. However, the no-cloningtheorem in quantum mechanics precludes standard backpropagation, leading toprohibitive quantum resource costs when applying VQAs to large-scale tasks. Toaddress this challenge, we reformulate the training dynamics of VQAs as anonlinear partial differential equation and propose a novel protocol thatleverages physics-informed neural networks (PINNs) to model this dynamicalsystem efficiently. Given a small amount of training trajectory data collectedfrom quantum devices, our protocol predicts the parameter updates of VQAs overmultiple iterations on the classical side, dramatically reducing quantumresource costs. Through systematic numerical experiments, we demonstrate thatour method achieves up to a 30x speedup compared to conventional methods andreduces quantum resource costs by as much as 90\% for tasks involving up to 40qubits, including ground state preparation of different quantum systems, whilemaintaining competitive accuracy. Our approach complements existing techniquesaimed at improving the efficiency of VQAs and further strengthens theirpotential for practical applications. <<<

Shuanghao Bai, Wenxuan Song, Jiayi Chen, Yuheng Ji, Zhide Zhong, Jin Yang, Han Zhao, Wanqi Zhou, Wei Zhao, Zhe Li, Pengxiang Ding, Cheng Chi, Haoang Li, Chang Xu, Xiaolong Zheng, Donglin Wang, Shanghang Zhang, Badong Chen <<<

Embodied intelligence has witnessed remarkable progress in recent years,driven by advances in computer vision, natural language processing, and therise of large-scale multimodal models. Among its core challenges, robotmanipulation stands out as a fundamental yet intricate problem, requiring theseamless integration of perception, planning, and control to enable interactionwithin diverse and unstructured environments. This survey presents acomprehensive overview of robotic manipulation, encompassing foundationalbackground, task-organized benchmarks and datasets, and a unified taxonomy ofexisting methods. We extend the classical division between high-level planningand low-level control by broadening high-level planning to include language,code, motion, affordance, and 3D representations, while introducing a newtaxonomy of low-level learning-based control grounded in training paradigmssuch as input modeling, latent learning, and policy learning. Furthermore, weprovide the first dedicated taxonomy of key bottlenecks, focusing on datacollection, utilization, and generalization, and conclude with an extensivereview of real-world applications. Compared with prior surveys, our work offersboth a broader scope and deeper insight, serving as an accessible roadmap fornewcomers and a structured reference for experienced researchers. All relatedresources, including research papers, open-source datasets, and projects, arecurated for the community athttps://github.com/BaiShuanghao/Awesome-Robotics-Manipulation. <<<

Frontier reasoning models have exhibited incredible capabilities across awide array of disciplines, driven by posttraining large language models (LLMs)with reinforcement learning (RL). However, despite the widespread success ofthis paradigm, much of the literature has been devoted to disentangling trulynovel behaviors that emerge during RL but are not present in the base models.In our work, we approach this question from a different angle, instead askingwhether comparable reasoning capabilites can be elicited from base models atinference time by pure sampling, without any additional training. Inspired byMarkov chain Monte Carlo (MCMC) techniques for sampling from sharpeneddistributions, we propose a simple iterative sampling algorithm leveraging thebase models' own likelihoods. Over different base models, we show that ouralgorithm offers substantial boosts in reasoning that nearly match and evenoutperform those from RL on a wide variety of single-shot tasks, includingMATH500, HumanEval, and GPQA. Moreover, our sampler avoids the collapse indiversity over multiple samples that is characteristic of RL-posttraining.Crucially, our method does not require training, curated datasets, or averifier, suggesting broad applicability beyond easily verifiable domains. <<<

2048 is a stochastic single-player game involving 16 cells on a 4 by 4 grid,where a player chooses a direction among up, down, left, and right to obtain ascore by merging two tiles with the same number located in neighboring cellsalong the chosen direction. This paper presents that a variant 2048-4x3 12cells on a 4 by 3 board, one row smaller than the original, has been stronglysolved. In this variant, the expected score achieved by an optimal strategy isabout $50724.26$ for the most common initial states: ones with two tiles ofnumber 2. The numbers of reachable states and afterstates are identified to be$1,152,817,492,752$ and $739,648,886,170$, respectively. The key technique isto partition state space by the sum of tile numbers on a board, which we callthe age of a state. An age is invariant between a state and its successiveafterstate after any valid action and is increased two or four by stochasticresponse from the environment. Therefore, we can partition state space by agesand enumerate all (after)states of an age depending only on states with therecent ages. Similarly, we can identify (after)state values by going along withages in decreasing order. <<<

Runnan Fang, Shihao Cai, Baixuan Li, Jialong Wu, Guangyu Li, Wenbiao Yin, Xinyu Wang, Xiaobin Wang, Liangcai Su, Zhen Zhang, Shibin Wu, Zhengwei Tao, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou <<<

Advanced agentic intelligence is a prerequisite for deploying Large LanguageModels in practical, real-world applications. Diverse real-world APIs demandprecise, robust function-calling intelligence, which needs agents to developthese capabilities through interaction in varied environments. The breadth offunction-calling competence is closely tied to the diversity of environments inwhich agents are trained. In this work, we scale up environments as a steptowards advancing general agentic intelligence. This gives rise to two centralchallenges: (i) how to scale environments in a principled manner, and (ii) howto effectively train agentic capabilities from experiences derived throughinteractions with these environments. To address these, we design a scalableframework that automatically constructs heterogeneous environments that arefully simulated, systematically broadening the space of function-callingscenarios. We further adapt a two-phase agent fine-tuning strategy: firstendowing agents with fundamental agentic capabilities, then specializing themfor domain-specific contexts. Extensive experiments on agentic benchmarks,tau-bench, tau2-Bench, and ACEBench, demonstrate that our trained model,AgentScaler, significantly enhances the function-calling capability of models. <<<

Giovanni Acampora, Andris Ambainis, Natalia Ares, Leonardo Banchi, Pallavi Bhardwaj, Daniele Binosi, G. Andrew D. Briggs, Tommaso Calarco, Vedran Dunjko, Jens Eisert, Olivier Ezratty, Paul Erker, Federico Fedele, Elies Gil-Fuster, Martin Gärttner, Mats Granath, Markus Heyl, Iordanis Kerenidis, Matthias Klusch, Anton Frisk Kockum, Richard Kueng, Mario Krenn, Jörg Lässig, Antonio Macaluso, Sabrina Maniscalco, Florian Marquardt, Kristel Michielsen, Gorka Muñoz-Gil, Daniel Müssig, Hendrik Poulsen Nautrup, Sophie A. Neubauer, Evert van Nieuwenburg, Roman Orus, Jörg Schmiedmayer, Markus Schmitt, Philipp Slusallek, Filippo Vicentini, Christof Weitenberg, Frank K. Wilhelm <<<

This white paper discusses and explores the various points of intersectionbetween quantum computing and artificial intelligence (AI). It describes howquantum computing could support the development of innovative AI solutions. Italso examines use cases of classical AI that can empower research anddevelopment in quantum technologies, with a focus on quantum computing andquantum sensing. The purpose of this white paper is to provide a long-termresearch agenda aimed at addressing foundational questions about how AI andquantum computing interact and benefit one another. It concludes with a set ofrecommendations and challenges, including how to orchestrate the proposedtheoretical work, align quantum AI developments with quantum hardware roadmaps,estimate both classical and quantum resources - especially with the goal ofmitigating and optimizing energy consumption - advance this emerging hybridsoftware engineering discipline, and enhance European industrialcompetitiveness while considering societal implications. <<<

The International Mathematical Olympiad (IMO) poses uniquely challengingproblems requiring deep insight, creativity, and formal reasoning. While LargeLanguage Models (LLMs) perform well on mathematical benchmarks like AIME, theystruggle with Olympiad-level tasks. We use Google's Gemini 2.5 Pro on the newlyreleased IMO 2025 problems, avoiding data contamination. Using aself-verification pipeline with careful prompt design, 5 (out of 6) problemsare solved correctly. This result underscores the importance of developingoptimal strategies to harness the full potential of powerful LLMs for complexreasoning tasks. <<<

Large Language Models (LLMs) have demonstrated strong capabilities but remain fundamentally static, unable to adapt their internal parameters to novel tasks, evolving knowledge domains, or dynamic interaction contexts. As LLMs are increasingly deployed in open-ended, interactive environments, this static nature has become a critical bottleneck, necessitating agents that can adaptively reason, act, and evolve in real time. This paradigm shift -- from scaling static models to developing self-evolving agents -- has sparked growing interest in architectures and methods enabling continual learning and adaptation from data, interactions, and experiences. This survey provides the first systematic and comprehensive review of self-evolving agents, organized around three foundational dimensions -- what to evolve, when to evolve, and how to evolve. We examine evolutionary mechanisms across agent components (e.g., models, memory, tools, architecture), categorize adaptation methods by stages (e.g., intra-test-time, inter-test-time), and analyze the algorithmic and architectural designs that guide evolutionary adaptation (e.g., scalar rewards, textual feedback, single-agent and multi-agent systems). Additionally, we analyze evaluation metrics and benchmarks tailored for self-evolving agents, highlight applications in domains such as coding, education, and healthcare, and identify critical challenges and research directions in safety, scalability, and co-evolutionary dynamics. By providing a structured framework for understanding and designing self-evolving agents, this survey establishes a roadmap for advancing adaptive agentic systems in both research and real-world deployments, ultimately shedding lights to pave the way for the realization of Artificial Super Intelligence (ASI), where agents evolve autonomously, performing at or beyond human-level intelligence across a wide array of tasks. <<<

This paper introduces Genesis, the first compiler designed to supportHamiltonian Simulation on hybrid continuous-variable (CV) and discrete-variable(DV) quantum computing systems. Genesis is a two-level compilation system. Atthe first level, it decomposes an input Hamiltonian into basis gates using thenative instruction set of the target hybrid CV-DV quantum computer. At thesecond level, it tackles the mapping and routing of qumodes/qubits to implementlong-range interactions for the gates decomposed from the first level. Ratherthan a typical implementation that relies on SWAP primitives similar toqubit-based (or DV-only) systems, we propose an integrated design ofconnectivity-aware gate synthesis and beamsplitter SWAP insertion tailored forhybrid CV-DV systems. We also introduce an OpenQASM-like domain-specificlanguage (DSL) named CVDV-QASM to represent Hamiltonian in terms ofPauli-exponentials and basic gate sequences from the hybrid CV-DV gate set.Genesis has successfully compiled several important Hamiltonians, including theBose-Hubbard model, $\mathbb{Z}_2-$Higgs model, Hubbard-Holstein model,Heisenberg model and Electron-vibration coupling Hamiltonians, which arecritical in domains like quantum field theory, condensed matter physics, andquantum chemistry. Our implementation is available atGenesis-CVDV-Compiler(https://github.com/ruadapt/Genesis-CVDV-Compiler). <<<

We construct $\varepsilon$-approximate unitary $k$-designs on $n$ qubits incircuit depth $O(\log k \log \log n k / \varepsilon)$. The depth isexponentially improved over all known results in all three parameters $n$, $k$,$\varepsilon$. We further show that each dependence is optimal up toexponentially smaller factors. Our construction uses $\tilde{{O}}(nk)$ ancillaqubits and ${O}(nk)$ bits of randomness, which are also optimal up to $\log(nk)$ factors. An alternative construction achieves a smaller ancilla count$\tilde{{O}}(n)$ with circuit depth ${O}(k \log \log nk/\varepsilon)$. Toachieve these efficient unitary designs, we introduce a highly-structuredrandom unitary ensemble that leverages long-range two-qubit gates and low-depthimplementations of random classical hash functions. We also develop a newanalytical framework for bounding errors in quantum experiments involving manyqueries to random unitaries. As an illustration of this framework'sversatility, we provide a succinct alternative proof of the existence ofpseudorandom unitaries. <<<

A major challenge in the burgeoning field of quantum simulation forhigh-energy physics is the realization of scalable $2+1$D lattice gaugetheories on state-of-the-art quantum hardware, which is an essential steptowards the overarching goal of probing $3+1$D quantum chromodynamics on aquantum computer. Despite great progress, current experimental implementationsof $2+1$D lattice gauge theories are mostly restricted to relatively smallsystem sizes and two-level representations of the gauge and electric fields.Here, we propose a resource-efficient method for quantum simulating $2+1$Dspin-$S$ $\mathrm{U}(1)$ quantum link lattice gauge theories with dynamicalmatter using qudit-based quantum processors. By integrating out the matterfields through Gauss's law, we reformulate the quantum link model in a purelyspin picture compatible with qudit encoding across arbitrary spatialdimensions, eliminating the need for ancillary qubits and reducing resourceoverhead. Focusing first on the spin-$1/2$ case, we construct explicit circuitsfor the full Hamiltonian and demonstrate through numerical simulations that thefirst-order Trotterized circuits accurately capture the quench dynamics even inthe presence of realistic noise levels. Additionally, we introduce a generalmethod for constructing coupling-term circuits for higher-spin representations$S>1/2$. Compared to conventional qubit encodings, our framework significantlyreduces the number of quantum resources and gate count. Our approachsignificantly enhances scalability and fidelity for probing nonequilibriumphenomena in higher-dimensional lattice gauge theories, and is readily amenableto implementation on state-of-the-art qudit platforms. <<<

Games have played a pivotal role in advancing artificial intelligence, withAI agents using sophisticated techniques to compete. Despite the success ofneural network based game AIs, their performance often requires significantcomputational resources. In this paper, we present Rapfi, an efficient Gomokuagent that outperforms CNN-based agents in limited computation environments.Rapfi leverages a compact neural network with a pattern-based codebookdistilled from CNNs, and an incremental update scheme that minimizescomputation when input changes are minor. This new network uses computationthat is orders of magnitude less to reach a similar accuracy of much largerneural networks such as Resnet. Thanks to our incremental update scheme,depth-first search methods such as the alpha-beta search can be significantlyaccelerated. With a carefully tuned evaluation and search, Rapfi reachedstrength surpassing Katagomo, the strongest open-source Gomoku AI based onAlphaZero's algorithm, under limited computational resources where acceleratorslike GPUs are absent. Rapfi ranked first among 520 Gomoku agents on Botzone andwon the championship in GomoCup 2024. <<<

Yuri Alexeev, Marwa H. Farag, Taylor L. Patti, Mark E. Wolf, Natalia Ares, Alán Aspuru-Guzik, Simon C. Benjamin, Zhenyu Cai, Zohim Chandani, Federico Fedele, Nicholas Harrigan, Jin-Sung Kim, Elica Kyoseva, Justin G. Lietz, Tom Lubowe, Alexander McCaskey, Roger G. Melko, Kouhei Nakaji, Alberto Peruzzo, Sam Stanwyck, Norm M. Tubman, Hanrui Wang, Timothy Costa <<<

Artificial intelligence (AI) advancements over the past few years have had anunprecedented and revolutionary impact across everyday application areas. Itssignificance also extends to technical challenges within science andengineering, including the nascent field of quantum computing (QC). Thecounterintuitive nature and high-dimensional mathematics of QC make it a primecandidate for AI's data-driven learning capabilities, and in fact, many of QC'sbiggest scaling challenges may ultimately rest on developments in AI. However,bringing leading techniques from AI to QC requires drawing on disparateexpertise from arguably two of the most advanced and esoteric areas of computerscience. Here we aim to encourage this cross-pollination by reviewing howstate-of-the-art AI techniques are already advancing challenges across thehardware and software stack needed to develop useful QC - from device design toapplications. We then close by examining its future opportunities and obstaclesin this space. <<<

How can we teach humanoids to climb staircases and sit on chairs using thesurrounding environment context? Arguably, the simplest way is to just showthem-casually capture a human motion video and feed it to humanoids. Weintroduce VIDEOMIMIC, a real-to-sim-to-real pipeline that mines everydayvideos, jointly reconstructs the humans and the environment, and produceswhole-body control policies for humanoid robots that perform the correspondingskills. We demonstrate the results of our pipeline on real humanoid robots,showing robust, repeatable contextual control such as staircase ascents anddescents, sitting and standing from chairs and benches, as well as otherdynamic whole-body skills-all from a single policy, conditioned on theenvironment and global root commands. VIDEOMIMIC offers a scalable path towardsteaching humanoids to operate in diverse real-world environments. <<<

Ensuring that large language models (LLMs) generate outputs aligned withhuman preferences is important for safe and effective AI interactions. WhileDirect Preference Optimization (DPO) employs an implicit reward function tooptimize the policy model, however, it and its related variants overlook thedifferential importance of individual tokens and are sensitive to judgmentnoise in preference datasets during generation. Although recent methods attemptto assess the important weight of tokens via probability prediction orsimplistic weighting schemes, these evaluation methods are prone to biases andstill cannot fully address these issues. To solve this problem, we propose theToken-Importance Guided Direct Preference Optimization (TI-DPO), whichintroduces two key innovations: the gradient-based token-importance weightsthat dynamically prioritize critical tokens, and a triple loss that explicitlyguides model outputs to approach human-preferred responses and stay away fromnon-preferred responses. Experimental results show that TI-DPO achieves higheraccuracy and stronger generative diversity, providing more stable andcomputationally efficient solutions compared with DPO and other RLHF methods. <<<

Binjie Guo, Hanyu Zheng, Guowei Su, Ru Zhang, Haohan Jiang, Xurong Lin, Hongyan Wei, Aisheng Mo, Jie Li, Zhiyuan Qian, Zhuhao Zhang, Xiaoyuan Cheng <<<

Recent years have witnessed significant progress in reinforcement learning,especially with Zero-like paradigms, which have greatly boosted thegeneralization and reasoning abilities of large-scale language models.Nevertheless, existing frameworks are often plagued by high implementationcomplexity and poor reproducibility. To tackle these challenges, we presentAlphaZero-Edu, a lightweight, education-focused implementation built upon themathematical framework of AlphaZero. It boasts a modular architecture thatdisentangles key components, enabling transparent visualization of thealgorithmic processes. Additionally, it is optimized for resource-efficienttraining on a single NVIDIA RTX 3090 GPU and features highly parallelizedself-play data generation, achieving a 3.2-fold speedup with 8 processes. InGomoku matches, the framework has demonstrated exceptional performance,achieving a consistently high win rate against human opponents. AlphaZero-Eduhas been open-sourced at https://github.com/StarLight1212/AlphaZero_Edu,providing an accessible and practical benchmark for both academic research andindustrial applications. <<<