rubrics

KO | EN

gitlite — search

#javascript #python #react #ai #go #android #rust #deep-learning #docker #cli #awesome-list #mcp #ios #open-source

(★ 16)

a bunch of rubrics I made in different format and structure for llm judge and other use cases

rubrics Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# rubrics
A bunch of rubrics I made in different format and structure for llm judge and other use cases

the goal of this repo is, as naming implies, just a singular place for me to talk or push my rubrics, instead of using single gist links.
I'm doing a lot of different things and perhaps seeing or using rubrics in a very flexible way compared to the literature.

First let's define the official definition, of a rubric. Let's first go on good ol' wikipedia as baseline:
https://en.wikipedia.org/wiki/Rubric_(academic)
<img width="996" height="700" alt="image" src="https://github.com/user-attachments/assets/0b4bb934-17bf-4e8b-aa31-56ab9f00dc20" />
Now I'm not going to bore you with the details and going to assume you already have a rough idea of what a rubric is at this point.
Now, what do I do differently? of course I'm still staying pretty close from baseline here, but I introduce the following, as of time of writing:
1. structure, so XML or JSON, etc
2. tied scoring with IDs and reference within the structure, so <C1> is linked to C1:, etc
3. strong constraints, both semantical and structural (refer to 2. here)
4. roleplaying baked in, eg: think like, you are, etc
5. support for feedback, so it explain how to improve it
6. support for reasoning (why it got judged this way)
7. mostly phylosophical outlook, but (roleplaying == jailbreak == context following) == rubrics

there is a lot more tidbits but this will be for the perhaps, soon to be blog I will make on this...

rubrics

rubrics Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

rubrics

rubrics Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README