inference

(★ 9,504)

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

파일 탐색기

최종 버전 다운로드 (.zip)

파일 수가 많아 일부만 표시됩니다. 전체 파일은 위 다운로드 버튼으로 확인해 주세요.

- - bug_report.yaml
  - feature_request.yaml
- - validate_gen_docs_pr.py
- - assign.yaml
  - build-pypiserver-image.yaml
  - docker-cd.yaml
  - issue.yaml
  - pr_auto_run_gen_docs.yaml
  - python.yaml
  - release.yaml
- demo.gif
- index.jpg
- screenshot.png
- stay_ahead.gif
- xinference-downloading.png
- xorbits-logo.png
- benchmark_embedding.py
- benchmark_latency.py
- benchmark_long.py
- benchmark_rerank.py
- benchmark_runner.py
- benchmark_serving.py
- README.md
- utils.py
- - conf.py
  - gen_docs.py
  - index.rst
  - init_locales.py
  - norm_zh.py
- - audio.rst.jinja
  - audio_index.rst.jinja
  - embedding.rst.jinja
  - embedding_index.rst.jinja
  - image.rst.jinja
  - image_index.rst.jinja
  - llm.rst.jinja
  - llm_index.rst.jinja
  - metrics.jinja
  - rerank.rst.jinja
  - rerank_index.rst.jinja
  - video.rst.jinja
  - video_index.rst.jinja
- build_i18n.py
- fix_po_rest_colons.py
- i18n_locales.py
- Makefile
- review_po_translations.py
- scan_po_issues.py
- - logo.png
- - stage-export.mjs
- .env.development
- .gitignore
- .prettierrc
- eslint.config.mjs
- next.config.ts
- package-lock.json
- package.json
- postcss.config.js
- README.md
- tailwind.config.js
- tsconfig.json
- - README.md
  - README_zh-CN.md
  - rules-ja.yml
  - rules-ko.yml
  - rules-zh-CN.yml
  - rules.yml
- - dcgm-custom-metrics.csv
  - dcgm-custom-metrics.zh-CN.csv
  - dcgm-exporter.yml
  - README.md
  - README_zh-CN.md
- - docker-compose.yml
  - es-audit-index-template.json
  - es-ilm-policy.json
  - es-index-template.json
  - es-init.sh
  - filebeat-json-to-es.yml
  - filebeat-json-to-kafka.yml
  - filebeat-text-to-es.yml
  - filebeat-text-to-kafka.yml
  - filebeat-to-es.yml
  - filebeat-to-kafka.yml
  - README.md
  - README_zh-CN.md
- - README.md
  - README_zh-CN.md
- README_de.md
- README_es.md
- README_fr.md
- README_it.md
- README_ja_JP.md
- README_ko.md
- README_pt_BR.md
- README_zh_CN.md
- README_zh_TW.md
- - __init__.py
  - dependencies.py
  - frontend_static.py
  - pdf_ocr.py
  - responses.py
  - restful_api.py
  - utils.py
- - __init__.py
  - common.py
  - handlers.py
- - __init__.py
  - autostart.py
  - cache_tracker.py
  - event.py
  - exceptions.py
  - http_protocol.py
  - launch_history_store.py
  - launch_strategy.py
  - log.py
  - metrics.py
  - model.py
  - monitor_config_store.py
  - otel.py
  - progress_tracker.py
  - replica_config.py
  - resource.py
  - router_config_store.py
  - router_registry.py
  - status_guard.py
  - supervisor.py
  - tokenizer_asset_registry.py
  - utils.py
  - virtual_env_manager.py
  - worker.py
- - __init__.py
  - cmdline.py
  - local.py
  - router.py
  - supervisor.py
  - utils.py
  - worker.py
- - __init__.py
  - batch.py
  - cache_manager.py
  - core.py
  - custom.py
  - utils.py
- - __init__.py
  - admission.py
  - app.py
  - backend.py
  - classifier.py
  - config.py
  - control_plane.py
  - metrics.py
  - runtime.py
  - schemas.py
  - service.py
  - sse.py
  - tokenization.py
  - tokenization_worker.py
  - tokenizer.py
  - tokenizer_asset.py
- - test_build_backend.py
  - test_logging_filters.py
  - test_persisted_secret.py
- - __init__.py
- __init__.py
- _compat.py
- conftest.py
- constants.py
- device_utils.py
- fields.py
- isolation.py
.dockerignore
.git_archival.txt
.gitattributes
.gitignore
.pre-commit-config.yaml
.readthedocs.yaml
AGENTS.md
build_backend.py
build_web.py
CLAUDE.md
LICENSE
MANIFEST.in
pyproject.toml
README.md
SECURITY.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

inference

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

inference

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README