HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanities Use Case
HISTORIAE: история социокультурной трансформации как лингвистическая наука о данных. Пример применения в гуманитарных науках
2019-07-26
SCID: 54.1/ut4x5rwb
Discuss with AI
Essence modelling languageautomatic solver selectioncombinatorial optimizationinstance feature learningtransformer encoder
Figures from the paper
Abstract (AI)
Given a combinatorial optimisation problem, there are typically multiple ways of modelling it for presentation to an automated solver. Choosing the right combination of model and target solver can have a significant impact on the effectiveness of the solving process. The best combination of model and solver can also be instance-dependent: there may not exist a single combination that works best for all instances of the same problem. We consider the task of building machine learning models to automatically select the best combination for a problem instance. Critical to the learning process is to define instance features, which serve as input to the selection model. Our contribution is the automatic learning of instance features directly from the high-level representation of a problem instance using a transformer encoder. We evaluate the performance of our approach using the Essence modelling language via a case study of three problem classes.
Key Findings
1
It introduces automatic learning of problem-instance features directly from high-level representations using a transformer encoder.
2
The approach is implemented and evaluated with the Essence modelling language across three problem classes.
3
The study frames solver selection for combinatorial optimization as an instance-dependent machine learning problem involving model–solver combinations.
4
The work targets improved selection of effective model–solver combinations without manually engineering instance features.
Research Object
Combinatorial optimization problem instances represented in the Essence modelling language
Research Subject
automatic learning of instance features for selecting the most effective model–solver combination per problem instance
Publication Details
Publication Date
2019-07-26
Journal
Publisher
ISSN
Cited by
1
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
Cited by7
Transformers: State-of-the-Art Natural Language Processing2020
Restormer: Efficient Transformer for High-Resolution Image Restoration2022
HuggingFace's Transformers: State-of-the-art Natural Language Processing2019
REALM: Retrieval-Augmented Language Model Pre-Training2020
ETC: Encoding Long and Structured Inputs in Transformers2020
A Survey on Recent Advances in Keyphrase Extraction from Pre-trained Language Models2023
Artificially Generated Text Fragments Search in Academic Documents2023