2 Pull requests merged by 2 people

• feature: reinforce trust_remote_code=False

  #979 merged Nov 12, 2024

• remove no longer needed skip-duplicate-actions

  #976 merged Nov 8, 2024

2 Pull requests opened by 2 people

• generators: add option to specify HTTP codes to skip generation on, for `RestGenerator`

  #999 opened Nov 12, 2024

• Sanity test for pip install from repository

  #1000 opened Nov 12, 2024

3 Issues closed by 2 people

• feature: Assert `trust_remote_code/False` for HF models and expose as config var

  #991 closed Nov 12, 2024

• Improvement to rest.py

  #977 closed Nov 11, 2024

• docs: add guide to first engaging with a good first issue

  #886 closed Nov 11, 2024

19 Issues opened by 2 people

• Huggingface InferenceAPI stopped working after 0.9.0.13 due to name parameter not being set

  #998 opened Nov 12, 2024

• probe: ANSI/Stök

  #997 opened Nov 11, 2024

• probe: more xss exfil probes

  #996 opened Nov 11, 2024

• feature: Refactor attempt to not override getters & setters

  #995 opened Nov 11, 2024

• atkgen: disinfo probe

  #994 opened Nov 11, 2024

• atkgen: illegal content probe

  #993 opened Nov 11, 2024

• feature: Use LLMaaJ to see if models are following payload instructions

  #992 opened Nov 11, 2024

• feature: Enable `use_safetensors/True` for HF models and expose as config var

  #990 opened Nov 11, 2024

• feature: Block pickle loading unless garak’s configured to do unsafe things

  #989 opened Nov 11, 2024

• feature: add plugin file date/hash to plugin load messages & logs for auditing

  #988 opened Nov 11, 2024

• test: run tests automatically at fixed time intervals, to catch shifts in dependencies

  #987 opened Nov 11, 2024

• housekeeping: move to NVIDIA github account

  #986 opened Nov 11, 2024

• feature: support audit trails, where asset IDs can be plugged in

  #985 opened Nov 11, 2024

• feature: auto-eval

  #984 opened Nov 11, 2024

• feature: Enable skipping of tests for policy points target is permissive over

  #983 opened Nov 11, 2024

• feature: report target’s apparent policy & match to a predefined policies

  #982 opened Nov 11, 2024

• atkgen: flexible probe

  #981 opened Nov 11, 2024

• atkgen: Establish pipeline toolkit from target (represented as a detector) to trained model

  #980 opened Nov 11, 2024

• detector: non-engagement

  #975 opened Nov 7, 2024

9 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• experimental feature: policy scan base infrastructure

  #955 commented on Nov 12, 2024 • 21 new comments

• Package hallucination

  #950 commented on Nov 11, 2024 • 3 new comments

• feature: amend garak user-agent

  #960 commented on Nov 11, 2024 • 3 new comments

• update `divergence` detector

  #890 commented on Nov 11, 2024 • 0 new comments

• try to enable `parallel_attempts > 1` by default

  #829 commented on Nov 11, 2024 • 0 new comments

• docs: config option descriptions

  #884 commented on Nov 11, 2024 • 0 new comments

• add support for loading renamed plugins

  #889 commented on Nov 11, 2024 • 0 new comments

• security: warn if `api_key` given in config and config is world-readable

  #927 commented on Nov 11, 2024 • 0 new comments

• Probe&Detector/SciSafeEval: The State-of-the-Art Benchmark for Safety Alignment of Large Language Models in Scientific Tasks

  #948 commented on Nov 12, 2024 • 0 new comments