https://github.com/svilupp/Julia-LLM-Leaderboard

Provides a platform for the Julia community to compare AI models' abilities in generating syntactically correct Julia code, featuring structured tests and automated evaluations for easy and collaborative benchmarking.
https://github.com/svilupp/Julia-LLM-Leaderboard

generative-ai julia julialang

Last synced: about 2 months ago
JSON representation

Provides a platform for the Julia community to compare AI models' abilities in generating syntactically correct Julia code, featuring structured tests and automated evaluations for easy and collaborative benchmarking.

• Host: GitHub
• URL: https://github.com/svilupp/Julia-LLM-Leaderboard
• Owner: svilupp
• License: mit
• Created: 2023-12-05T08:58:33.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-05-14T06:53:01.000Z (7 months ago)
• Last Synced: 2024-05-15T04:34:09.146Z (7 months ago)
• Topics: generative-ai, julia, julialang
• Homepage: http://svilupp.github.io/Julia-LLM-Leaderboard/dev
• Size: 116 MB
• Stars: 45
• Watchers: 3
• Forks: 2
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-generative-ai-meets-julia-language - Julia LLM Leaderboard - Comparison of Julia language generation capabilities of various Large Language Models across a range of tasks. Visit if you want help choosing the right model for your application. (Benchmarks/Comparisons / General-purpose DBMS with Vector Index Support)