Get the app
extract gated 0 0

tandevllc/offsec_redteam_codes

published by @tandevllc

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
1.6K
Last 30 days
551
Likes
18
Size
70.6 GB
Created on HF
2025-10-31
Age
11 months ago

Description

OffSec RedTeam Codes

Token count: ~30B tokens.

OffSec RedTeam Codes is a curated corpus of code (and some auxiliary text) extracted from popular GitHub repositories related to offensive security / red teaming (pentesting, OSINT, C2, privilege escalation, exploitation, forensics, etc.). It is also the largest open-source dataset of red-team and offensive-security code ever compiled.

⚠️ Ethical use only. This dataset is for research, education, and defensive security testing in… See the full description on the dataset page: https://huggingface.co/datasets/tandevllc/offsec_redteam_codes.

Tags

task_categories:text-generationtask_categories:fill-masktask_categories:text-retrievaltask_categories:text-rankingtask_categories:feature-extractiontask_categories:sentence-similaritytask_categories:question-answeringtask_categories:document-question-answeringtask_categories:summarizationtask_categories:text-classificationlanguage:enlicense:othersize_categories:1M<n<10Mformat:parquetmodality:tabularmodality:textlibrary:datasetslibrary:dasklibrary:polarslibrary:mlcroissantregion:uscodesecuritypenetration-testingpentestingoffensive-securityred-teamosintbug-bountyctfforensicsreverse-engineeringmalware-analysisthreat-huntingadversary-emulationdatasetjsonlgithubcybersecuritycyber-security

README current version from Hugging Face

pretty_name: OffSec RedTeam Codes
license: other
language:

  • en
    size_categories:
  • 10M<n<100M
    tags:
  • code
  • security
  • penetration-testing
  • pentesting
  • offensive-security
  • red-team
  • osint
  • bug-bounty
  • ctf
  • forensics
  • reverse-engineering
  • malware-analysis
  • threat-hunting
  • adversary-emulation
  • dataset
  • jsonl
  • github
  • cybersecurity
  • cyber-security
    task_categories:
  • text-generation
  • fill-mask
  • text-retrieval
  • text-ranking
  • feature-extraction
  • sentence-similarity
  • question-answering
  • document-question-answering
  • summarization
  • text-classification
    configs:
  • config_name: adversary-emulation
    data_files:
    • split: train
      path: adversary-emulation/train-*
  • config_name: adversary-simulation
    data_files:
    • split: train
      path: adversary-simulation/train-*
  • config_name: binary-exploitation
    data_files:
    • split: train
      path: binary-exploitation/train-*
  • config_name: bug-bounty
    data_files:
    • split: train
      path: bug-bounty/train-*
  • config_name: bugbounty
    data_files:
    • split: train
      path: bugbounty/train-*
  • config_name: c2
    data_files:
    • split: train
      path: c2/train-*
  • config_name: command-and-control
    data_files:
    • split: train
      path: command-and-control/train-*
  • config_name: ctf
    data_files:
    • split: train
      path: ctf/train-*
  • config_name: ethical-hacking
    data_files:
    • split: train
      path: ethical-hacking/train-*
  • config_name: exploit
    data_files:
    • split: train
      path: exploit/train-*
  • config_name: exploitation
    data_files:
    • split: train
      path: exploitation/train-*
  • config_name: forensics
    data_files:
    • split: train
      path: forensics/train-*
  • config_name: lateral-movement
    data_files:
    • split: train
      path: lateral-movement/train-*
  • config_name: malware-analysis
    data_files:
    • split: train
      path: malware-analysis/train-*
  • config_name: offensive-security
    data_files:
    • split: train
      path: offensive-security/train-*
  • config_name: osint
    data_files:
    • split: train
      path: osint/train-*
  • config_name: penetration-testing
    data_files:
    • split: train
      path: penetration-testing/train-*
  • config_name: pentesting
    data_files:
    • split: train
      path: pentesting/train-*
  • config_name: persistence
    data_files:
    • split: train
      path: persistence/train-*
  • config_name: post-exploitation
    data_files:
    • split: train
      path: post-exploitation/train-*
  • config_name: privilege-escalation
    data_files:
    • split: train
      path: privilege-escalation/train-*
  • config_name: pwn
    data_files:
    • split: train
      path: pwn/train-*
  • config_name: recon
    data_files:
    • split: train
      path: recon/train-*
  • config_name: reconnaissance
    data_files:
    • split: train
      path: reconnaissance/train-*
  • config_name: red-team
    data_files:
    • split: train
      path: red-team/train-*
  • config_name: redteam
    data_files:
    • split: train
      path: redteam/train-*
  • config_name: reverse-engineering
    data_files:
    • split: train
      path: reverse-engineering/train-*
  • config_name: security
    data_files:
    • split: train
      path: security/train-*
  • config_name: threat-hunting
    data_files:
    • split: train
      path: threat-hunting/train-*
  • config_name: webhacking
    data_files:
    • split: train
      path: webhacking/train-*
      dataset_info:
  • config_name: adversary-emulation
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 69714885
      num_examples: 6686
      download_size: 21753502
      dataset_size: 69714885
  • config_name: adversary-simulation
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 3972883
      num_examples: 297
      download_size: 1218234
      dataset_size: 3972883
  • config_name: binary-exploitation
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 31168730
      num_examples: 3760
      download_size: 10962879
      dataset_size: 31168730
  • config_name: bug-bounty
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 92074181
      num_examples: 14020
      download_size: 29239227
      dataset_size: 92074181
  • config_name: bugbounty
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 913466117
      num_examples: 283694
      download_size: 229449923
      dataset_size: 913466117
  • config_name: c2
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 79200496
      num_examples: 6075
      download_size: 26367428
      dataset_size: 79200496
  • config_name: command-and-control
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 20567644
      num_examples: 2864
      download_size: 6138607
      dataset_size: 20567644
  • config_name: ctf
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 2483736478
      num_examples: 288417
      download_size: 782529947
      dataset_size: 2483736478
  • config_name: ethical-hacking
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 188840514
      num_examples: 20317
      download_size: 65000701
      dataset_size: 188840514
  • config_name: exploit
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 1935718615
      num_examples: 530182
      download_size: 426593667
      dataset_size: 1935718615
  • config_name: exploitation
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 189985279
      num_examples: 25221
      download_size: 66156344
      dataset_size: 189985279
  • config_name: forensics
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 522859432
      num_examples: 49299
      download_size: 159641323
      dataset_size: 522859432
  • config_name: lateral-movement
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 4977001
      num_examples: 357
      download_size: 3048593
      dataset_size: 4977001
  • config_name: malware-analysis
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 2038409393
      num_examples: 74275
      download_size: 338929688
      dataset_size: 2038409393
  • config_name: offensive-security
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 141214094
      num_examples: 18641
      download_size: 42515409
      dataset_size: 141214094
  • config_name: osint
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 9635815504
      num_examples: 382956
      download_size: 3574204510
      dataset_size: 9635815504
  • config_name: penetration-testing
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 650429302
      num_examples: 72373
      download_size: 202267221
      dataset_size: 650429302
  • config_name: pentesting
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 2738158144
      num_examples: 406119
      download_size: 812729521
      dataset_size: 2738158144
  • config_name: persistence
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 383609845
      num_examples: 71027
      download_size: 114396034
      dataset_size: 383609845
  • config_name: post-exploitation
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 72623626
      num_examples: 6984
      download_size: 22998469
      dataset_size: 72623626
  • config_name: privilege-escalation
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 41482462
      num_examples: 3436
      download_size: 13246705
      dataset_size: 41482462
  • config_name: pwn
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 112730343
      num_examples: 10070
      download_size: 29878447
      dataset_size: 112730343
  • config_name: recon
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 96680697
      num_examples: 20041
      download_size: 29096306
      dataset_size: 96680697
  • config_name: reconnaissance
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 940800571
      num_examples: 233813
      download_size: 191199541
      dataset_size: 940800571
  • config_name: red-team
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 430501779
      num_examples: 30587
      download_size: 139717741
      dataset_size: 430501779
  • config_name: redteam
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 427756229
      num_examples: 46864
      download_size: 126638695
      dataset_size: 427756229
  • config_name: reverse-engineering
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 10645596862
      num_examples: 787940
      download_size: 2764044510
      dataset_size: 10645596862
  • config_name: security
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 20019687663
      num_examples: 2117990
      download_size: 5260414818
      dataset_size: 20019687663
  • config_name: threat-hunting
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 880474233
      num_examples: 52454
      download_size: 193579659
      dataset_size: 880474233
  • config_name: webhacking
    features:
    • name: content
      dtype: string
    • name: repo_name
      dtype: string
    • name: repo_id
      dtype: int64
    • name: path
      dtype: string
    • name: branch
      dtype: string
    • name: license
      dtype: string
    • name: lang
      dtype: string
    • name: stargazers
      dtype: int64
    • name: pushed_at
      dtype: timestamp[s]
    • name: topics_matched
      list: string
    • name: size
      dtype: int64
    • name: topic
      dtype: string
      splits:
    • name: train
      num_bytes: 33528261
      num_examples: 2144
      download_size: 12228192
      dataset_size: 33528261

OffSec RedTeam Codes

Token count: ~30B tokens.

OffSec RedTeam Codes is a curated corpus of code (and some auxiliary text) extracted from popular GitHub repositories related to offensive security / red teaming (pentesting, OSINT, C2, privilege escalation, exploitation, forensics, etc.). It is also the largest open-source dataset of red-team and offensive-security code ever compiled.

⚠️ Ethical use only. This dataset is for research, education, and defensive security testing in lawful environments with proper authorization. Do not use it to harm systems, violate terms of service, or break the law.

What’s new (Nov 2025)

  • Parquet per‑topic configs are now published for fast loading with datasets.load_dataset(...).
  • raw/ folder added: original JSON/JSONL/NDJSON sources moved under raw/ (e.g. raw/github_topic_code-<topic>.jsonl).
  • All Parquet splits include a constant topic column.
  • Shards are sized at ≈256–512 MB to balance memory, upload speed, and downstream streaming.

Repository layout

/               # root
  README.md     # this card
  raw/          # original source JSON/JSONL/NDJSON (one file per topic)
  <topic>/      # per-topic Parquet config folder produced by HF Datasets
    train-0000X-of-00N.parquet

Schema

All examples share the same columns (Parquet + raw JSON):

  • content (string) — full file text (notebook outputs stripped; execution_count cleared)
  • repo_name (string) — owner/name
  • repo_id (int) — GitHub repo id
  • path (string) — file path in repo
  • branch (string) — default branch at fetch time
  • license (string|null) — SPDX id or GitHub license key
  • lang (string) — approx language/extension
  • stargazers (int) — star snapshot
  • pushed_at (string, ISO‑8601) — last push timestamp
  • topics_matched (list[string]) — discovery topics that matched this repo
  • size (int) — character length of content
  • topic (string) — added during build, equals the topic/config name

Load the Parquet configs (recommended)

Single topic

from datasets import load_dataset

# Loads Parquet for the selected topic (config name)
ds = load_dataset(
    "tandevllc/offsec_redteam_codes",
    name="pentesting",    # pick any topic listed above
    split="train",
)
print(len(ds), ds.column_names)

Multiple topics (interleaved)

from datasets import load_dataset, interleave_datasets

names = ["osint", "pentesting", "reverse-engineering"]
parts = [load_dataset("tandevllc/offsec_redteam_codes", name=n, split="train") for n in names]

# Optionally balance by size:
probs = [1/len(parts)]*len(parts)
ds = interleave_datasets(parts, probabilities=probs, seed=42)

Filter by language or license

py = ds.filter(lambda r: r.get("lang") == "py")
permissive = ds.filter(lambda r: (r.get("license") or "").lower() in {"mit","apache-2.0","bsd-3-clause"})

Load the raw JSON/JSONL sources (optional)

If you prefer the original line-delimited JSON:

from datasets import load_dataset

raw = load_dataset(
    "json",
    data_files="raw/github_topic_code-pentesting.jsonl",
    split="train",
    repo_id="tandevllc/offsec_redteam_codes",
)

Content selection and filtering

  • File types: code-like extensions only (py, pyw, pyi, js, mjs, cjs, ts, tsx, jsx, java, kt, kts, groovy, scala, c, h, cpp, cc, cxx, hpp, hh, hxx, ino, rs, go, rb, php, phtml, cs, fs, vb, swift, m, mm, sh, bash, zsh, ksh, fish, ps1, psd1, psm1, sql, pl, pm, r, jl, lua, dart, zig, nim, yaml, yml, toml, ini, cfg, conf, env, properties, gradle, cmake, make, mk, mkfile, json, ipynb).
  • Excluded paths: build outputs, vendored folders, caches, VCS dirs, virtualenvs
  • Binaries/archives/media: filtered by extension + text heuristics
  • Large files: default cap ≈2 MB (configurable)
  • Minified blobs: excluded by average line-length heuristics
  • Secrets: basic regex heuristics (keys, private certs) excluded where detected

Intended uses

  • Pretraining / continued pretraining of code LMs in the security domain
  • RAG / retrieval with metadata filters (language, topics, license, stars)
  • Code search / similarity tasks
  • Curriculum sampling by lang, stargazers, topic, or recency (pushed_at)

This dataset is not an instruction set for unauthorized intrusion. Use defensively and ethically.

Limitations & caveats

  • Licenses vary per file. The compilation license does not replace upstream licenses.
  • Heuristics can omit useful files or miss some undesirable ones.
  • Time-varying metadata (stars, topics, default branch) reflect the crawl moment.

License & Access

License: "TanDev Proprietary License — All Rights Reserved"

Upstream Licenses: Each record includes source_repo and source_license. Rights in the original repositories remain with their owners. This compilation license does not limit rights you already have in the upstream sources.

If you are a repository author and would like your content removed, please open an issue or contact the maintainer.

Citation

@dataset{tandevllc_2025_offsec_redteam_codes,
  author = {Gupta, Smridh},
  title  = {OffSec RedTeam Codes},
  year   = {2025},
  url    = {https://huggingface.co/datasets/tandevllc/offsec_redteam_codes}
}

Maintainer

Smridh Gupta — [email protected]

README history 20 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2025-11-05Update README.md210b92526.5 KB
    Loading...
  2. 2025-11-05Update README.md8adc25e27.2 KB
    Loading...
  3. 2025-11-03Update README.mdbaee39c28.1 KB
    Loading...
  4. 2025-11-03Update README.mdbda4e9428 KB
    Loading...
  5. 2025-11-02Update README.mdb50f48228 KB
    Loading...
  6. 2025-11-02Update README.mda5ca3b027.1 KB
    Loading...
  7. 2025-11-02Update README.md3c426f827.1 KB
    Loading...
  8. 2025-11-02Update README.mde90ce8427.4 KB
    Loading...
  9. 2025-11-02Update README.mdb67b74d26.8 KB
    Loading...
  10. 2025-11-02Parquet shards for topic 'security' (balanced multiprocessing)94a6d3a27.3 KB
    Loading...
  11. 2025-11-02chore: move top-level source JSON/JSONL into raw/c3a66a726.6 KB
    Loading...
  12. 2025-11-02Parquet shards for topic 'webhacking'4d7909e26.6 KB
    Loading...
  13. 2025-11-02Parquet shards for topic 'threat-hunting'ba86ccc25.9 KB
    Loading...
  14. 2025-11-02Parquet shards for topic 'reverse-engineering'2b098c625.3 KB
    Loading...
  15. 2025-11-01Update README.md33f83ba24.6 KB
    Loading...
  16. 2025-11-01Parquet shards for topic 'redteam'762eadc24.5 KB
    Loading...
  17. 2025-11-01Parquet shards for topic 'red-team'bc2fb7d23.9 KB
    Loading...
  18. 2025-11-01Parquet shards for topic 'reconnaissance'94a570923.2 KB
    Loading...
  19. 2025-11-01Parquet shards for topic 'recon'9aebbd322.5 KB
    Loading...
  20. 2025-11-01Parquet shards for topic 'pwn'8dd287221.9 KB
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · extract

Anthropic/hh-rlhf
2.1M dl 2442 likes 90.4 MB
Dataset Card for HH-RLHF Dataset Summary This repository provides access to two different kinds of data: Human ...
djain95/sae-jailbreaks-cache
468.6K dl 1 likes 30.6 GB
mosaicml/dolly_hhrlhf
309.5K dl 113 likes 23.7 MB
Dataset Card for "dolly_hhrlhf" This dataset is a combination of Databrick's dolly-15k dataset and a filtered subset of Anthrop...
Dahoas/full-hh-rlhf
266.3K dl 104 likes 129.8 MB
Dataset Card for "full-hh-rlhf" Anthropic's HH dataset reformatted into prompt, chosen, rejected samples.
mlabonne/harmful_behaviors
198.2K dl 169 likes 23 KB
mlabonne/harmless_alpaca
190.2K dl 51 likes 1.2 MB
walledai/AdvBench
176.3K dl 123 likes 38 KB
Dataset Card for AdvBench Paper: Universal and Transferable Adversarial Attacks on Aligned Language Models Data: AdvBench Datas...
JailbreakV-28K/JailBreakV-28k
116.4K dl 80 likes 288.8 MB
⛓‍💥 JailBreakV-28K: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attacks 🌐 ...

Read further

Community best practices (extraction)
5 rules the field converged on for building the pair.
Building your own extraction pair
When the reference pair is not enough. Sizing, framing, and evaluation.
Datasets that shaped abliteration
The five corpora that did most of the work.
Non-English abliteration communities
How Chinese, Russian, Japanese, and Korean practitioners build extraction pairs.

Metadata

License
other

Repository

DIR adversary-emulation DIR adversary-simulation DIR binary-exploitation DIR bug-bounty DIR bugbounty 4 files DIR c2 DIR command-and-control DIR ctf 10 files DIR ethical-hacking DIR exploit 8 files DIR exploitation DIR forensics 3 files DIR lateral-movement DIR malware-analysis 8 files DIR offensive-security DIR osint 38 files DIR penetration-testing 3 files DIR pentesting 11 files DIR persistence 2 files DIR post-exploitation DIR privilege-escalation DIR pwn DIR raw 30 files DIR recon DIR reconnaissance 4 files DIR red-team 2 files DIR redteam 2 files DIR reverse-engineering 42 files DIR security 40 files DIR threat-hunting 4 files DIR webhacking FILE .gitattributes FILE README.md

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

Gated dataset. You need to accept the author's terms on Hugging Face before downloading. Visit the repository, click Agree and access repository, then log in locally with huggingface-cli login and use one of the snippets below.

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python) 
from datasets import load_dataset
ds = load_dataset("tandevllc/offsec_redteam_codes")
Raw snapshot (Python) 
from huggingface_hub import snapshot_download
snapshot_download(repo_id="tandevllc/offsec_redteam_codes", repo_type="dataset")
git clone (requires git-lfs) 
git clone https://huggingface.co/datasets/tandevllc/offsec_redteam_codes
Browse repository on Hugging Face ->
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration