Sustainable science mapping: benchmarking green AI against transformers for cross-disciplinary abstract classification using arXiv.

Overview

1. Department of Statistics, Middle East Technical University,Ankara, 06800 Turkey

Abstract

The exponential growth of scholarly literature necessitates automated, scalable systems for organizing knowledge domains. However, text classification of academic abstracts presents distinct challenges due to specialized terminology and diverse discourse structures across disciplines. This study proposes a resource efficient deep learning methodology to categorize academic abstracts, scaling from coarse grained domains (arXiv) to fine grained disciplinary hierarchies (Web of Science). Systematic comparative analysis of Recurrent Neural Networks (Attention-GRU) and Transformer based architectures (BERT, SciBERT) are conducted, specifically focusing on the trade-off between predictive accuracy and computational efficiency. Extensive experiments on massive benchmarks that include the WOS-46985 dataset with 134 sub-disciplines, reveal a notable finding: Our proposed Attention-based GRU model utilizing static GloVe embeddings achieved a Macro-F1 score of 0.920, achieving higher performance than leading domain specific models such as SciBERT (F1: 0.867). Furthermore, this accuracy was achieved with over 3 faster training times and significantly lower estimated energy proxy compared to Transformer variants. This research contributes to the field by providing a systematic evaluation of “Green AI” architectures, demonstrating that computationally efficient models can robustly handle the linguistic diversity of high cardinality, fine grained scientific taxonomies without the prohibitive estimated energy costs of Large Language Models.

Reproduced under the paper's license (CC BY), from the paper cited above.

Code

The paper links to its data, not to its authors' code: see the Data section.

The paper's code and data availability statement is in the Data section.

Tracing map

A tracing map links a paper to the code its authors published: this paper has none, so it has no map.

Data

Datasets cited

• doi:10.17632/9rw3vkcfy4.6, at the source; found in the references

Data availability

The datasets generated and analyzed during the current study are available in the GitHub repository: https://github.com/mrkn7/sustainable-science-mapping. The raw data was harvested using the open-access arXiv API.

Reproduced under the paper's license (CC BY), from the paper cited above.

Versions

The history of this record: each version stored by the harvester or made by a correction of its authors or of the maintainers of its code, and what changed in its facts. The texts of the paper (its abstract, its availability statements) are not part of it; versions that changed only those are not listed.

Version 1, 28 September 2026: the first record

Recorded: type, language, journal, volume, issue, pages, dates, 2 authors, 7 keywords, 29 references.

Cite

This paper

Erkan, M. A., & Yozgatlıgil, C. (2026). Sustainable science mapping: benchmarking green AI against transformers for cross-disciplinary abstract classification using arXiv. Scientific reports, 16(1), 22195. https://doi.org/10.1038/s41598-026-48795-7

Similar papers

The papers with a page that share the most with this one: the tools found in their code, their categories, datasets, cited references and authors, the rarest counting most.

[1] doi:10.1038/s41598-026-62977-3

Hyperparameter-optimized deep learning for next-day pH forecasting in distributed water quality monitoring systems.

Journal: Scientific reports

In common: methods / tools, 1 reference

[2] doi:10.1038/s41597-026-08034-0 [code]

A standardized naturalistic audio stimulus dataset with unsupervised labeling.

Journal: Scientific data

In common: methods / tools, 1 reference

[3] doi:10.7554/elife.101204 [code]

Larger language models better align with neural representations of natural language.

Journal: eLife

In common: 1 reference

[4] doi:10.1162/imag.a.1227 [code]

Large language models reveal the neural tracking of linguistic context in attended and unattended multi-talker speech.

Journal: Imaging neuroscience (Cambridge, Mass.)

In common: 1 reference

[5] doi:10.7554/elife.106543 [code]

Stimulus dependencies-rather than next-word prediction-can explain pre-onset brain encoding in naturalistic listening designs.

Journal: eLife

In common: 1 reference

Contribute

The authors of this paper can claim it, correct its record and validate its tracing map, and the maintainers of its code (its owner, or a public member of its organization) correct what it says of their repository; anyone signed in can ask for its removal. Every request goes to OSCR's own machine, which answers it; your account page follows them.

Request its removal

To ask OSCR to remove this record, the copies of its authors' scripts or its tracing map, use the removal request page: signed in, you say who you are, what to remove and why, then review and confirm the request. Published rules decide every request (how).

Discussion: questions and error reports about this paper and its code, from signed-in readers and its authors. It opens with sign-in.

Reproductions: reports from readers who ran the authors' code: what they reproduced, with which environment, commit and data. It opens with sign-in.

Activity: what happens around this paper: new versions of its record, its map's validation, discussions and reproductions. It opens with sign-in.