Kinetics-TPS

KO | EN

gitlite — search

#python #react #ai #typescript #llm #golang #macos #awesome #kubernetes #awesome-list #security #mcp #ios #open-source

(★ 13)

ICCV DeeperAction Challenge - Kinetics-TPS Challenge on Part-level Action Parsing and Action Recognition.

Kinetics-TPS 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Kinetics-TPS
ICCV DeeperAction Challenge - Kinetics-TPS Challenge on Part-level Action Parsing and Action Recognition.

![overview](https://raw.githubusercontent.com/Hypnosx/Kinetics-TPS/main/overview.gif)

#### Overview

---

Traditionally, action recognition has been treated as a high-level video classification problem. However, such manner ignores detailed and middle-level understanding about human actions. To fill this gap, we deeply investigate action recognition in videos, by explicitly encoding human actions as spatio-temporal composition of body parts. Specifically, we develop a large-scale Kinetics-Temporal Part State (Kinetics-TPS) benchmark for this study. Different from existing video action datasets, our Kinetics-TPS provides 7.9M annotations of 10 body parts, 7.9M part state (i.e., how a body part moves) and 0.5M interactive objects in the video frames of 24 human action classes, which bring new opportunity to understand human action by compositional learning of body parts. You can downloads data at https://competitions.codalab.org/competitions/32360#participate after registration.

#### Space Requirement

---

- train_videos：~ 4.96 GB
- test_videos：~ 1.26 GB
- annotations:  ~ 348.6 MB
- list:  ~ 68 KB
- total: ~ 6.56 GB

#### Dataset Structure

---

After unzipping the files, you will get all the data in the following folder structure:

```
Kinetics-TPS
 |--train_videos
    |--classes_name
       <24 folders named by classes>
       |--videos_name.mp4
           <3809 mp4 files named by videos>
 |--test_videos
    |--classes_name
       <24 folders named by classes>
       |--videos_name.mp4
           <932 mp4 files named by videos>
 |--train_annotations
    |--classes_name
       <24 folders named by classes>
       |--videos_name
           <3809 folders named by videos>
           |--videos_name
               < 574851 json files named by image_id>
 |--list
   |--body_part.txt
      <10 categories of parts labels>
   |--part_stat.txt
      <74 categories of part_state labels>
   |--object.txt
      <75 categories of objects labels>
   |--video_train_flist.csv
      <number of frames per video in train set>
   |--video_test_flist.csv
      <number of frames per video in test set>

```

#### Documents

---

We will provide some detailed information about Kinetics-KPS dataset. You can also refer to https://deeperaction.github.io/kineticstps/.

###### Frame Extraction

-	We use mmaction2 ’s tools/data/build_rawframes.py and mmcv==1.1.5 to extract frames. Frame name format is img_%05d.jpg, index start from 1.
-	You can check the number of extracting frames results from the files: video_train_flist.csv and video_test_flist.csv.

###### Detailed Information of Vocabulary

- body part：
  - Human limbs must be distinguished between left and right.
- part state:
  - The label 'others' means the other part states that undefined in our vocabulary.
  - The label 'none' means the stat of body parts without movement.
- object:
  - The annotated objects labels refer to objects that interacted with body parts. 
  - The label 'none' means the other objects that undefined in our vocabulary.

Kinetics-TPS

Kinetics-TPS 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Kinetics-TPS

Kinetics-TPS 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README