size_categories:10K<n<100K format:parquet modality:tabular modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
dataset_info:
  features:
  - name: id
    dtype: string
  - name: submitter
    dtype: string
  - name: authors
    dtype: string
  - name: title
    dtype: string
  - name: comments
    dtype: string
  - name: journal-ref
    dtype: string
  - name: doi
    dtype: string
  - name: report-no
    dtype: string
  - name: categories
    dtype: string
  - name: license
    dtype: string
  - name: orig_abstract
    dtype: string
  - name: versions
    list:
    - name: created
      dtype: string
    - name: version
      dtype: string
  - name: update_date
    dtype: string
  - name: authors_parsed
    sequence:
      sequence: string
  - name: abstract
    dtype: string
  - name: prompt
    dtype: string
  - name: y_true
    dtype: string
  - name: comp_s1-L-3.1-8B-base
    dtype: string
  - name: preds_s1-L-3.1-8B-base
    dtype: string
  - name: comp_s3-L-3.1-8B-base_v3
    dtype: string
  - name: preds_s3-L-3.1-8B-base_v3
    dtype: string
  - name: comp_Llama-3.1-8B
    dtype: string
  - name: preds_Llama-3.1-8B
    dtype: string
  - name: comp_s2-L-3.1-8B-base
    dtype: string
  - name: preds_s2-L-3.1-8B-base
    dtype: string
  - name: score_s1-L-3.1-8B-base
    dtype: float64
  - name: score_s3-L-3.1-8B-base_v3
    dtype: float64
  - name: score_Llama-3.1-8B
    dtype: float64
  - name: score_s2-L-3.1-8B-base
    dtype: float64
  splits:
  - name: test
    num_bytes: 168006609
    num_examples: 15808
  download_size: 73513509
  dataset_size: 168006609
configs:
- config_name: default
  data_files:
  - split: test
    path: data/test-*
---


A copy of the dataset LLMsForHepth/infer_hep_th with additional columns `score_s1-L-3.1-8B-base`, `score_s3-L-3.1-8B-base_v3`,
`score_Llama-3.1-8B` and `score_s2-L-3.1-8B-base`.

The additional columns contain the cosine similarities between the sequences in `abstract` and `y_pred` where `y_pred` is taken from 
[`comp_s1-L-3.1-8B-base`, `comp_s3-L-3.1-8B-base_v3`,
`comp_Llama-3.1-8B`, `comp_s2-L-3.1-8B-base`]. The model used to create the embeddings is `jinaai/jina-embeddings-v3`.