QuantumVE

KO | EN

gitlite — search

#python #react #ai #go #android #machine-learning #rust #linux #macos #java #security #openai #mcp #open-source

(★ 10)

Vision Transformer embeddings enable scalable quantum SVMs with real-world accuracy gains.

QuantumVE Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![License: CC BY-NC-SA 4.0](https://img.shields.io/badge/License-CC%20BY--NC--SA%204.0-lightgrey.svg)](https://creativecommons.org/licenses/by-nc-sa/4.0/)
[![Python Version](https://img.shields.io/badge/python-3.10%20%7C%203.11%20%7C%203.12-blue.svg)](https://github.com/sebasmos/QuantumVE/)
[![arXiv](https://img.shields.io/badge/arXiv-2508.00024-b31b1b.svg)](https://arxiv.org/abs/2508.00024)
[![CEUR-WS](https://img.shields.io/badge/CEUR--WS-Vol--4153-blue.svg)](https://ceur-ws.org/Vol-4153/paper21.pdf)

**Published in:**
**Proceedings of the 3rd International Workshop on AI for Quantum and Quantum for AI (AIQxQIA 2025)**, co-located with the 28th European Conference on Artificial Intelligence (ECAI 2025), Bologna, Italy, 25 October 2025.
CEUR Workshop Proceedings, Vol. 4153.
Edited by Marco Baioletti (University of Perugia), Miguel Angel Gonzalez (University of Oviedo), Corrado Loglisci (University of Bari), Angelo Oddi (CNR), Riccardo Rasconi (CNR), and Ramiro Varela (University of Oviedo).

# Embedding Aware Quantum Classical SVMs for Scalable Quantum Machine Learning

**🚀 Key Discovery:**
Vision Transformer (ViT) embeddings unlock quantum machine learning advantage. This is the **first systematic evidence** that the choice of embeddings determines quantum kernel success, showing a fundamental synergy between transformer attention and quantum feature spaces.

### 🔗 Project Resources

* **Project Page:** [Embedding Aware Quantum](https://sebasmos.github.io/embedding-aware-quantum/)
* **GitHub Repository:** [QuantumVE](https://github.com/sebasmos/QuantumVE)
* **Peer Reviewed Paper (CEUR-WS):** [paper21.pdf, Vol. 4153](https://ceur-ws.org/Vol-4153/paper21.pdf)
* **Preprint (arXiv):** [Embedding Aware Quantum Classical SVMs](https://arxiv.org/abs/2508.00024)
* **Dataset on HuggingFace:** [QuantumEmbeddings](https://huggingface.co/datasets/sebasmos/QuantumEmbeddings)
* **Interactive Demo:** [Colab Notebook](https://github.com/sebasmos/QuantumVE/blob/main/Demo.ipynb)

### 🎯 Breakthrough Results

* **Fashion MNIST:** +8.02% accuracy vs classical SVM
* **MNIST:** +4.42% accuracy boost
* **Embedding Insights:** ViT embeddings enable quantum advantage; CNN features degrade performance
* **Scalability:** 16 qubit tensor network simulation via cuTensorNet
* **Efficiency:** Class balanced k means distillation for quantum data preprocessing

## Project Architecture

```
QuantumVE/
├── data_processing/     # Class balanced k means distillation procedures
├── embeddings/          # Vision Transformer & CNN embedding extraction
├── qve/                 # Core quantum classical modules and utilities
└── scripts/             # Experimental pipelines with cross validation
    ├── classical_baseline.py           # Traditional SVM benchmarks
    ├── cross_validation_baseline.py    # Cross validation framework
    └── qsvm_cuda_embeddings.py         # Our embedding aware quantum method
```

## 🚀 Quick Start

### 1. Environment Setup
```bash
# Create conda environment
conda create -n QuantumVE python=3.11 -y
conda activate QuantumVE

# Clone and install
git clone https://github.com/sebasmos/QuantumVE.git
cd QuantumVE
pip install -e .

# For Ryzen devices, install MPI
conda install -c conda-forge mpi4py openmpi
```

### 2. Download Pre computed Embeddings

**MNIST Embeddings:**
```bash
mkdir -p data && \
wget https://huggingface.co/datasets/sebasmos/QuantumEmbeddings/resolve/main/mnist_embeddings.zip && \
unzip mnist_embeddings.zip -d data && \
rm mnist_embeddings.zip
```

**Fashion MNIST Embeddings:**
```bash
mkdir -p data && \
wget https://huggingface.co/datasets/sebasmos/QuantumEmbeddings/resolve/main/fashionmnist_embeddings.zip && \
unzip fashionmnist_embeddings.zip -d data && \
rm fashionmnist_embeddings.zip
```

### 3. Run Experiments

**Single Node:**
```bash
# Classical baseline with cross validation
python scripts/classical_baseline.py

# Cross validation framework  
python scripts/cross_validation_baseline.py

# Our embedding aware quantum method
python scripts/qsvm_cuda_embeddings.py
```

**Multi Node with MPI:**
```bash
# Run with 2 processes
mpirun -np 2 python scripts/qsvm_cuda_embeddings.py
mpirun -np 2 python scripts/cross_validation_baseline.py
```

## 🔬 What Makes This Work?

Our key insight: **embedding choice is critical for quantum advantage**. While CNN features degrade in quantum systems, Vision Transformer embeddings create a unique synergy with quantum feature spaces, enabling measurable performance gains through:

1. **Class balanced distillation** reduces quantum overhead while preserving critical patterns
2. **ViT attention mechanisms** align naturally with quantum superposition states
3. **Tensor network simulation** scales to practical problem sizes (16+ qubits)

## 🤝 Contributing

We welcome contributions! Help us advance quantum machine learning:

1. Fork the [QuantumVE repository](https://github.com/sebasmos/QuantumVE)
2. Create your feature branch (`git checkout -b feature/amazing-feature`)
3. Submit a pull request with detailed description

**Areas for contribution:**
* New embedding architectures (BERT, CLIP, etc.)
* Additional quantum backends
* Performance optimizations
* Documentation improvements

## 🙏 Acknowledgements

This work was supported by the **Google Cloud Research Credits program** under award number **GCP19980904**.

## 📄 License

[CC BY-NC-SA 4.0](https://github.com/sebasmos/QuantumVE/blob/main/LICENSE)

## 📚 Citation

### Peer Reviewed Proceedings (CEUR-WS)
```bibtex
@inproceedings{ordonez2025embedding,
  title     = {Embedding Aware Quantum Classical SVMs for Scalable Quantum Machine Learning},
  author    = {Ord{\'o}{\~n}ez, Sebasti{\'a}n Andr{\'e}s Cajas and Torres, Luis Fernando Torres and Bifulco, Mario and Duran, Carlos Andres and Bosch, Cristian and Carbajo, Ricardo Simon},
  booktitle = {Proceedings of the 3rd International Workshop on AI for Quantum and Quantum for AI (AIQxQIA 2025), co-located with the 28th European Conference on Artificial Intelligence (ECAI 2025)},
  editor    = {Baioletti, Marco and Gonzalez, Miguel Angel and Loglisci, Corrado and Oddi, Angelo and Rasconi, Riccardo and Varela, Ramiro},
  series    = {CEUR Workshop Proceedings},
  volume    = {4153},
  year      = {2025},
  month     = {October},
  address   = {Bologna, Italy},
  publisher = {CEUR-WS.org},
  url       = {https://ceur-ws.org/Vol-4153/paper21.pdf}
}
```

### Preprint (arXiv)
```bibtex
@misc{ordonez2025embeddingarxiv,
  title         = {Embedding Aware Quantum Classical SVMs for Scalable Quantum Machine Learning},
  author        = {Ord{\'o}{\~n}ez, Sebasti{\'a}n Andr{\'e}s Cajas and Torres, Luis Fernando Torres and Bifulco, Mario and Duran, Carlos Andres and Bosch, Cristian and Carbajo, Ricardo Simon},
  year          = {2025},
  eprint        = {2508.00024},
  archivePrefix = {arXiv},
  url           = {https://arxiv.org/abs/2508.00024}
}
```

---

**🌟 Star us on GitHub if this helps your research! 🌟**

</div>

QuantumVE

QuantumVE Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

QuantumVE

QuantumVE Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README