英国 AI 安全研究所 (AISI) 发布大模型安全评测工具 ControlArena
大模型安全和评测这块，之前出的 Inspect 框架的英国 AI 安全研究所 (AISI) 。最近他们又开源了新工具 ControlArena。这玩意主要用来在受控的沙盒环境里，自动化评估大模型 Agent 的自主性边界和潜在危险能力。
官网：
https://cdn3.ldstatic.com/original/4X/f/8/c/f8caba8271be4baa7db0887299ba3f6e3886ada9.svg
Inspect (https://inspect.aisi.org.uk/)
https://cdn3.ldstatic.com/optimized/4X/b/0/0/b0099f113ad5b7c8b16cf43c9a2ff9919bb8883a_2_690x361.png
Inspect (https://inspect.aisi.org.uk/)
Open-source framework for large language model evaluations
项目：
github.com (https://github.com/UKGovernmentBEIS/control-arena)
https://cdn3.ldstatic.com/optimized/4X/8/a/a/8aafc56948bcd1f61cb822a99cfdff78040d84e5_2_690x344.png
GitHub - UKGovernmentBEIS/control-arena: ControlArena is a collection of settings, model... (https://github.com/UKGovernmentBEIS/control-arena)
ControlArena is a collection of settings, model organisms and protocols - for running control experiments.
github.com (https://github.com/UKGovernmentBEIS/inspect_ai?tab=readme-ov-file)
https://cdn3.ldstatic.com/optimized/4X/b/e/2/be253be35376f9b2cd510dae7dbe8f712a91e161_2_690x344.png
GitHub - UKGovernmentBEIS/inspect_ai: Inspect: A framework for large language model... (https://github.com/UKGovernmentBEIS/inspect_ai?tab=readme-ov-file)
Inspect: A framework for large language model evaluations
页:
[1]