Search

What are you looking for?

10 results for alignment

AI·Anthropic's J-space analysis of Claude reveals a small subset of internal representations forming a functional global workspace for flexible reasoning, but the paper explicitly states this has no bearing on AI consciousness and clarifies the core of AI alignment research.

36氪 AI·36kr.com··2.7Opinionaillmanthropic

AI·XALPHA is a memory-driven AI quant researcher that uses multi-source research memory integrating external financial reports and prior discovery feedback, with Macro Brain for theme planning and archetype selection, Micro Brain for hypothesis-to-code translation and tri-alignment verification, and Cross Brain for feedback consolidation, enabling closed-loop continuous alpha discovery that outperforms baselines on CSI300.

arXiv cs.CL·arxiv.org··1.7Researchllmquantai-research

Most safety alignment work treats "detect the attack" as a text classification problem — does the prompt contain language the model's safety guardrails should catch. That assumption breaks down for LLM agents with real tool access. Here's a concrete case: take a known, public security vulnerability (a CVE), work out the sequence of tool calls that would exploit it, then have an LLM rewrite that a…

r/MachineLearning·reddit.com··0.2

Reinforcement learning (RL) for non-verifiable instruction following increasingly relies on LLM judges with prompt-specific rubrics as reward signals. While recent methods adapt these rubrics to the evolving policy during training, the training prompts themselves remain static, drawn from fixed corpora. This static approach often results in a critical misalignment between prompt difficulty and policy capability, leaving the judge unable to recover a discriminative reward signal when prompts fai…

HuggingFace Daily Papers·huggingface.co··0.2paper

Touch supplies the physical grounding needed to perceive intrinsic material properties, such as friction and compliance, that vision alone often cannot resolve. Recent efforts for equipping multimodal LLMs with this tactile sense, however, expose a zero-sum trade-off: the limited parameter budget of compact models forces a choice between acquiring the new sensory modality and preserving the established vision-language reasoning. We present Splash, a mask-isolated tactile alignment learning fram…

HuggingFace Daily Papers·huggingface.co··0.1paper