symmetry-stats-repgeom

KO | EN

gitlite — search

#javascript #hacktoberfest #react #ai #llm #android #machine-learning #rust #macos #awesome #vue #ios #mcp #openai

symmetry-stats-repgeom

(★ 11)

Symmetries in language statistics shape the geometry of model representations

symmetry-stats-repgeom 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Fourier Embeddings

This repository contains the experiments for the paper ["Symmetries in language statistics shape the geometry of model representations."](https://arxiv.org/abs/2602.15029v1)

Authors: Dhruva Karkada, Daniel Korchinski, Andres Nava, Matthieu Wyart, Yasaman Bahri.

## Data Preparation

- [prepare_enwiki.py](prepare_enwiki.py) - Downloads and preprocesses Wikipedia text, builds vocabulary, and creates a tokenized corpus
- [compute_cooccurrence.py](compute_cooccurrence.py) - Computes word co-occurrence statistics with configurable context windows

## Analysis Notebooks

- [fig1.ipynb](fig1.ipynb), [fig2.ipynb](fig2.ipynb), [fig3.ipynb](fig3.ipynb), [fig4.ipynb](fig4.ipynb) - Main text figures and various appendix figures
- [mstar.ipynb](mstar.ipynb) - Appendix figures for the M* co-occurrence matrix
- [lattice.ipynb](lattice.ipynb) - 2D lattice/grid embeddings
- [llm_activations_extraction.ipynb](llm_activations_extraction.ipynb) - Extraction of hidden activations from language models

## Requirements

See [pyproject.toml](pyproject.toml) for dependencies. Python 3.13+ required.

symmetry-stats-repgeom

symmetry-stats-repgeom 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

symmetry-stats-repgeom

symmetry-stats-repgeom 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README