Search

What are you looking for?

22 results for tool

AI·2025 saw multiple AI companionship app closures including Woebot (150M users, clinical tool shut down due to unsustainable economics) and Dot AI (vision divergence, funds exhausted), with global closures in at least five products and domestic in eight; survivors like Replika (post-data deletion), Character.AI (Google talent acquisition), and China's Xin Bing (ice) lost users amid regulatory scrutiny and high inference costs, revealing unsustainable business models lacking self-reinforcing revenue.

36氪 AI·36kr.com··2.6Researchaicompanionshipmarket

AI·This position paper reviews LLM-driven formal theorem provers and argues that current systems function mainly as solvers for well-defined problems, not as research agents capable of discovering new theorems or resolving open conjectures at the frontier. It identifies key limitations in datasets, exploration, tools, and collaboration and proposes a roadmap for AI4Math systems to support genuine mathematical research.

arXiv cs.CL·arxiv.org··1.8Researchllmformal-methodsai4math

The rapid development of large language models and multimodal large language models has accelerated the emergence of proactive agents capable of operating everyday tools and assisting users in real-world environments. However, existing benchmarks struggle to evaluate such agents effectively, as they often rely on sandboxed environments and single-turn evaluation paradigms. Moreover, their scenario-based task taxonomies mix multiple model capabilities within the same task category, making it dif…

HuggingFace Daily Papers·huggingface.co··0.6paper

Large language models (LLMs) increasingly act as integrated data-science agents, combining abstract reasoning with advanced tool use. Yet the relevant benchmark landscape largely divides into symbolic causal reasoning benchmarks without realistic data analysis or data analysis benchmarks without a principled causal data-generating structure. Furthermore, existing causal evaluation datasets are often restricted to curated examples from existing sources, with diversity coming from limited templat…

HuggingFace Daily Papers·huggingface.co··0.5paper

Modern LLMs are increasingly deployed in long-context applications such as retrieval-augmented generation, repository-level coding, and agentic workflows whose accumulated reasoning and tool traces routinely push the input an order of magnitude past the pretraining window, making zero-shot context extension the dominant deployment path for open-weight checkpoints. Most existing zero-shot methods fix a single rescaling factor up front, so an aggressive factor sacrifices short-context fidelity wh…

HuggingFace Daily Papers·huggingface.co··0.4paper

We present AgentLens, a production-assessed benchmark for interactive code agents. Most code-agent benchmarks reduce a run to a single bit -- did the task pass? -- but the people who actually use these agents experience the entire trajectory: how the agent follows instructions, uses its tools, verifies its own work, recovers from mistakes, and talks to them along the way. AgentLens evaluates that whole trajectory. It pairs formal verification, where an objective check exists, with LLM-written t…

HuggingFace Daily Papers·huggingface.co··0.2paper

Most safety alignment work treats "detect the attack" as a text classification problem — does the prompt contain language the model's safety guardrails should catch. That assumption breaks down for LLM agents with real tool access. Here's a concrete case: take a known, public security vulnerability (a CVE), work out the sequence of tool calls that would exploit it, then have an LLM rewrite that a…

r/MachineLearning·reddit.com··0.2

Large Language Models (LLMs) unlocked new possibilities in automated code writing, becoming the backbone of most code completion tools. While LLMs excel in mainstream languages, they often lack support for the so-called low-resource languages where training data is scarce. As a result, these languages lag behind in the quality of code completion tooling available to their communities. A concrete example is Pharo, a Smalltalk-inspired language whose IDE currently offers only single-token complet…

HuggingFace Daily Papers·huggingface.co··0.2paper

Share what your favorite models are right now and why. Given the nature of the beast in evaluating VLMs (untrustworthiness of benchmarks, immature tooling, intrinsic stochasticity), please be as detailed as possible in describing your setup (at least hardware and inference engine) nature of your usage (what applications, how much, personal/professional use) tools/frameworks/prompts etc. Rules Onl…

r/LocalLLaMA·reddit.com··0.1