ZIm/.github/workflows
Nathan Sobo 458ffaa134
Add new action to run agent eval (#29158)
The old one wasn't linking, and
https://github.com/zed-industries/zed/pull/29081 has a bunch of merge
conflicts. Wanted to start simple/small.

## Todo

* [x] Remove low-signal examples
* [x] Make the eval run on a cron, on main, and on any PR with the
`run-eval` label
* [x] Noise in logs about failure to write settings
    ```
[2025-04-21T20:45:04Z ERROR settings] Failed to write settings to file
"/home/runner/.config/zed/settings.json"
    
       Caused by:
No such file or directory (os error 2) at path
"/home/runner/.config/zed/.tmpLewFEs"
    ```
* [x] `Agentic loop stalled`
(https://github.com/zed-industries/zed/actions/runs/14581044243/job/40897622894)
* [x] Make sure that events are recorded in snowflake
* [ ] Change judge criteria to be more explicit about meanings of scores

Release Notes:

- N/A

---------

Co-authored-by: Antonio Scandurra <me@as-cii.com>
Co-authored-by: Agus Zubiaga <hi@aguz.me>
Co-authored-by: Max Brunsfeld <maxbrunsfeld@gmail.com>
Co-authored-by: Thomas Mickley-Doyle <tmickleydoyle@gmail.com>
2025-04-21 21:30:21 -07:00
..
bump_collab_staging.yml Update actions/checkout digest to 11bd719 (#19636) 2024-10-23 21:57:06 -04:00
bump_patch_version.yml ci: Restrict more jobs to only run in the zed-industries organization (#23803) 2025-01-28 21:30:42 +00:00
ci.yml Update actions/setup-node digest to 49933ea (#28897) 2025-04-18 11:31:02 -06:00
community_close_stale_issues.yml Update stale issue bot to run on Wednesday (#27437) 2025-03-25 16:40:43 +00:00
community_delete_comments.yml ci: Restrict more jobs to only run in the zed-industries organization (#23803) 2025-01-28 21:30:42 +00:00
community_release_actions.yml Preserve newlines in release notes email (#27670) 2025-03-28 11:42:37 -04:00
community_update_all_top_ranking_issues.yml Resurrect top-ranking issues script (#25433) 2025-02-23 14:24:56 -05:00
community_update_weekly_top_ranking_issues.yml Resurrect top-ranking issues script (#25433) 2025-02-23 14:24:56 -05:00
danger.yml Update actions/setup-node digest to 49933ea (#28897) 2025-04-18 11:31:02 -06:00
deploy_cloudflare.yml Update actions/upload-artifact digest to ea165f8 (#27115) 2025-03-19 17:55:06 -04:00
deploy_collab.yml collab: Remove LLM service (#28728) 2025-04-14 23:47:14 +00:00
eval.yml Add new action to run agent eval (#29158) 2025-04-21 21:30:21 -07:00
issue_response.yml Update actions/setup-node digest to 49933ea (#28897) 2025-04-18 11:31:02 -06:00
publish_extension_cli.yml Update swatinem/rust-cache digest to 9d47c6a (#27121) 2025-03-20 07:58:22 +02:00
randomized_tests.yml Update actions/setup-node digest to 49933ea (#28897) 2025-04-18 11:31:02 -06:00
release_nightly.yml Update actions/setup-node digest to 49933ea (#28897) 2025-04-18 11:31:02 -06:00
script_checks.yml ci: Add shellcheck for scripts (#20631) 2024-11-18 16:41:22 -05:00