Hugging Face's logo

mariusweiss
/
TaxBERT

Safetensors
English
roberta
Model card Files Community

TaxBERT

This repository accompanies the paper: Hechtner, F., Schmidt, L., Seebeck, A., & Weiß, M. (2025). How to design and employ specialized large language models for accounting and tax research: The example of TaxBERT. TaxBERT is a domain-adapated RoBERTa model, specifically designed to analyze qualitative corporate tax disclosures.

SSRN: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5146523 The paper provides an ‘A-to-Z’ description of how to design and employ specialized Bidirectional Encoder Representation of Transformers (BERT) models that are environmentally sustainable and practically feasible for accounting and tax researchers.

GitHub: https://github.com/TaxBERT/TaxBERT

If the following Guide/Repository is used for academic or scientific purposes, please cite the paper.

Downloads last month
1,106
Safetensors
Model size
82.4M params
Tensor type
F32
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.