Dr. Nicolay Rusnachenko

My name is Nicolay Runsnachenko, and I am post-doc Research Fellow at Bournemoth University, ex. Research Assistant at Newcastle University, UK. I defend my PhD in Natural Language Processing. I am majoring in Multimodal [image + text] Information Retrieval (IR) with Language Models from large documents of any kind: mass-media articles, news, literature books. I contribute in advances of large document processing in such fields as: Sentiment Analysis, Text Summarization, Dialogue Assistants. At present I am doing studies in medical domain by developing Multimodal [MRI-scans + reports] dialogue assistant and contribute to NHS advances.

Email  /  CV  /  LinkedIn  /  GitHub  / 
Google Scholar  / Research Gate / Semantic Scholar / Scopus /
TwitterNewsBlog

parkrun-code / parkrun-stat

Research:

Interested in sentiment analysis, machine learning, relation extraction. Representative papers are highlighted.

Large Language Models in Targeted Sentiment Analysis for Russian
Nicolay Rusnachenko, Anton Golubev, Natalia Loukachevitch
The 18th Lobachevskii Journal of Mathematics No.8 / LJoM-2024
Submitted on 16'th April 2024

(Journal Paper)
paper / code / llm-answers

We explore LLMs reasoning capabilities in Targeted Sentiment Analysis task. In particular we assess LLM models in two modes: (i) zero-shot-learning (ZSL) (ii) fine-tuning with prompt and CoT THoR proposed at ACL-2023. The fine-tuned Flan-T5-xl outperforms the prior top submission at RuSentNE-2023.

NCL_NLP at SemEval-2024 Task 7: CoT-NumHG: A CoT-Based SFT Training Strategy with Large Language Models for Number-Focused Headline Generation
Junzhe Zhao, Yingxi Wang, Huizhi Liang, Nicolay Rusnachenko
The 18th International Workshop on Semantic Evaluation
Co-located with NAACL 2024, June 16-21, 2024

Mexico City, Mexico
(Contest)
paper / code

nicolay-r at SemEval-2024 Task 3.1: Reasoning Emotion Cause Supported by Emotion State with Chain-of-Thoughts
Nicolay Rusnachenko, Huizhi Liang
The 18th International Workshop on Semantic Evaluation
Co-located with NAACL 2024, June 16-21, 2024

Mexico City, Mexico
(Contest)
paper / code-model / code-datasets / codalab / leaderboard

We fine-tune Flan-T5-base (250M) with the reforged THoR-ISA framework for Emotion Cause Extraction. Our final submission is 3'rd place by F1-proportional and 4-5'th by F1-strict which counts the emotion cause span borders. Our THOR-ECAC is publicly available.

ARElight-0.24.0: Context Sampling of Large Text for Deep Learning RE
Nicolay Rusnachenko, Huizhi Liang, Maxim Kolomeets, Lei Shi
46th European Conference on Information Retrieval, 24th-28th March, 2024
Glasgow, Scotland
(Demonstration Paper, Oral Presentation, Offline)
paper / demo / code / poster / old-landing-page
Old pre-release Version 0.22.0 related materials:
presentation / ml-trainings-youtube / video[rus]

AREkit-based application for a granular view onto sentiments between entities for large document collections, including books, mass-media, Twitter/X, and more. See our online demo

Advances in Sentiment Analysis of the Large Mass-Media Documents
Nicolay Rusnachenko
Glasgow IR Research Group, Sir Alwyn Williams Building, Glasgow, G12 8QN, 22 January 2024
Scotland, United Kingdom (UK)
(Oral Presentation)
event / video / slides

Unlike to the similar talks in past, in this one we overview the capabilities the most-recent instructive Large Language Models (LLM). This list includes: Mistral, Mixtral-7B, Flan-T5, Microsoft-Phi2, LLama2, etc. We also cover advances of LLM-fine tuning by exploiting Chain-of-Thoughts techniques to get the most out of the LLM capabilities.
Using Sentence Embedding Techniques for Enhancing Terms-of-Service Text Summarization
Harry Peach, Nicolay Rusnachenko, Mayank Baraskar, Huizhi Liang,
14th International Conference on Innovations in Bio-Inspired Computing and Applications (IBICA-2023), December 14-15, 2023
Kochi, India
(Oral Presentation, Online)
paper / code / video / presentation / certificate

ARElight: Context Sampling of Large Texts for Deep Learning Relation Extraction
Nicolay Rusnachenko, Huizhi Liang, Maxim Kolomeets, Lei Shi
Scalalable Research Group Seminars
Urban Sciences Building (Newcastle University), Newcastle Upon Tyne, 11'th March, 2023
England, United Kingdom (UK)
(Oral Presentation)
video / demo / agency-newcastle / technical-slides / code
Dialogue Agents with Literary Character Personality Traits
Junzhe Zhao, Huizhi Liang, Nicolay Rusnachenko
Proceedings of the The 22nd IEEE/WIC International Conference on Web Intelligence and Intelligent Agent Technology October 26-29, 2023
Venice, Italy
(Oral Presentation, Online)
doi / paper / eprint / code

To enhance the engagement of chatbots, we need to imbue them with unique personalities and speech patterns. We propose an automated system that uses character dialogues from literary works. We used the Chinese classic, Dream of the Red Chamber. Our system efficiently extracts dialogues and personality traits from the book, creates a personality map for each character, generates responses that reflect these traits.

How well ChatGPT-3.5 understands semantic relations in mass-media texts?
Nicolay Rusnachenko
(Personal Report)
video[rus] / presentation[rus] / code / prompts

This report represent a study of how well the annotated relations in NEREL collection are aligned with the ChatGPT-3.5 knowledge.

nclu_team at SemEval-2023 Task 6C1 and 6C2: Attention-based Approaches for Large Court Judgement Prediction with Explanation
Nicolay Rusnachenko, Thanet Markchom, Huizhi Liang
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023) Association for Computational Linguistics (ACL)
Toronto, Canada
(Contest)
paper / code / codalab

Legal_try at SemEval-2023 Task 6: Voting Heterogeneous Models for Entities identification in Legal Documents
Junzhe Zhao, Yingxi Wang, Nicolay Rusnachenko, Huizhi Liang
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023) Association for Computational Linguistics (ACL)
Toronto, Canada
(Contest)
paper / code

Application of the transformer-based model for the named entity recognition task in legal texts.

RuSentNE-2023: Named Entity Oriented Sentiment Analysis Task
Anton Golubev, Nicolay Rusnachenko, Natalia Loukachevitch
Dialogue-2023, Codalab platform, 2023
(Compebtitions)
bibtex / doi / preprint-arXiv / paper / code / codalab / info

Participants are offered the task of extracting sentiments of three classes (neg, pos, neutral) from news texts in relation to pre-marked entities such as PERSON, ORG, PROFESSION, COUNTRY, NATIONALITY within a separate sentence.

Pre-training LongT5 for Vietnamese Mass-Media Multi-document Summarization Task
Nicolay Rusnachenko, The Anh Le, Ngoc Diep Nguyen
Proceedings of the Artificial Intelligence and Natural Language Conference (AINL)
20-22'th April, 2023
Yerevan, Armenia
(Oral Presentation, Online)
preprint / paper-pomi / presentation / code

A first LongT5-based model pre-trained on a large amount of unlabeled Vietnamese texts and fine-tuned within the manually summarized texts from ViMS and VMDS and VLSP2022 collections

The Rivers Trust: The application of GNNs for river water quality sensor networks
Nicolay Rusnachenko, Andrew Johnson, Al-Amin Bashir Bugaje, Lingyi Yang, Tai-Ying Lee, Mohammad Matin Saddiqi, Mansi Mungee (PI)
The Catalyst (Newcastle University), Newcastle Upon Tyne, 21-24'th March, 2023
England, United Kingdom (UK)
(Oral Presentation)
youtube-presentation / event-link

Taking a facilitator Role in the The Rivers Trust project. The Rivers Trust company leads the Catchment Systems Thinking Cooperative (CaSTCo) project, which has been set up to provide a national framework for sharing water environment data across a range of stakeholders. To the best of our personal knowledge we were the first who experiment with the Graph Neural Networks application (GNN) for water quality assessment.

Advances in Sentiment Analysis of the Large Mass-Media Documents
Nicolay Rusnachenko Scalalable Research Group Seminars
Urban Sciences Building (Newcastle University), Newcastle Upon Tyne, 11'th March, 2023
England, United Kingdom (UK)
(Oral Presentation)
slides

In this talk we cover the advances of machine-learning approaches in sentiment analysis of large mass-media documents. Complements the past talk at Wolfson College (Oxford) with the detailed description of long-input transformers, RLHF training overview.

Paper Overview: ETC -- Encoding Long and Structured Inputs in Transformers
Nicolay Rusnachenko
The Alan Turing Institute, London, 3'rd March, 2023
England, United Kingdom (UK)
(Oral Presentation) / (Impromptu) / (Skimming Session)
slides / video

In this talk we examine the limitations of BERT model from the input size perspective. To address the shortcommings, authors propose a related position embeddings in order to implement local-window based sparse attention. To attend the distant tokens, authors propose a Global-Attention mechanism in addition to the sparsed one for the main input. Another main contribution is input structuring in attention mechanism.

Advances in Sentiment Analysis of the Large Mass-Media Documents
Nicolay Rusnachenko
OxfordXML, OxfordTalks
Wolfson College, University of Oxford, 10'th February, 2023
Oxford, England, United Kingdom (UK)
(Oral Presentation)
slides / details / awesome-repository / organizer

In this talk we cover the advances of machine-learning approaches in sentiment analysis of large mass-media documents. We provide both evolution of the task over time including a survey of task-oriented models starting from the conventional linear classification approaches to the applications findings of the recently announced ChatGPT model.

AREnets: Tensorflow-based framework of attentive neural-network models for text classfication and relation extraction tasks
Nicolay Rusnachenko
(Github Repository)
code

About Tensorflow-based framework which lists attentive implementation of the conventional neural network models (CNN, RNN-based), applicable for Relation Extraction classification tasks as well as API for custom model implementation

Sentiment Attitude Extraction Resources Translation
Nicolay Rusnachenko (Github Repository)
code / task

As a task, Sentiment Attitude Extraction is devoted to extraction of the sentiment connections from subjects towards objects mentioned in texts, usually analytical articles. This task has been originally proposed and becomes a part of the studies in RuSentRel dataset, in which texts are written in Russian.

Advances in Sentiment Attitude Extraction from Mass-Media Analytical Texts in Russian
Nicolay Rusnachenko
School of Informatics, Newcastle University, 9'th December, 2022
Newcastle Upon Tyne, England, United Kingdom (UK)
(Oral Presentation)
presentation

Introduction to Natural Language Processing for Reputation Tracking
Nicolay Rusnachenko
Marketing Trends and AI (DIFC Innovation HUB, Open Stage, 17'th August, 2022
(Presentation)
presentation / certificate / video

AREkit -- Attitude and Relation Extraction Toolkit
Nicolay Rusnachenko
(Framework)
code / presentation[rus] / releases

Document level Attitude and Relation Extraction toolkit (AREkit) for sampling mass-media news into datasets for your ML-model training and evaluation

ARElight -- application for processing and extracting sentiment attutides from large mass-media news
Nicolay Rusnachenko
DataFest-2022 3.0, Online, 18'th June, 2022
(Presentation)
code / presentation[rus] / video[rus] / project-page / AREkit

AREkit-based application for a granular view onto sentiments between entities in a mass-media texts written in Russian. Project presentation.

Model, Methods and Software Toolset for Sentiment Attitude Extraction Task via Frame-based Knowledge-Base
Nicolay Rusnachenko
Bauman Moscow State Technical University, Moscow, 28'th April, 2022
Published by High Attestation Comission
(Thesis Defence)
cert-ecctis-uk / certificate / thesis / synopsis / video / presentation / patent / HAC / task-paper / paper-styles

We propose distant-supervision approach for mass-media annotation, based on RuSentiFrames knowledge-base. We built and propose RuAttitudes collection for Sentiment Attitude Extraction task and adopt it for neural-networks training process, including BERT-based language models.

Search Interfaces for Biomedical Searching: How do Gaze, User Perception, Search Behaviour and Search Performance Relate?
Ying-Hsang Liu, Paul Thomas, Tom Gedeon, Nicolay Rusnachenko
ACM SIGIR Conference on Human Information Interaction and Retrieval, March 2022
Published by ACM
** Personal contribution were related to evaluation section and funded by Charles-Sturt-University, Australia (November 2017). See report for greater details.
(Online Presentation)
bibtex / paper / microsoft / video / slides / report

For Biomedical domain. We investigate: (1) which search interface elements searchers are look at when searching for docs to answer complex questions, and (2) relationship between individual differences and the interface elements which users are looked at.

Awesome Sentiment Attitude Extraction

This is a curated list of works devoted to sentiment attitude extraction domain. The latter considered as an area of studies, in which sentiment analysis and relation extraction are inextricably linked

Official RuSentRel-1.1 Leaderboard
Nicolay Rusnachenko
(Github Repository)

This repository is an official results benchmark for automatic sentiment attitude extraction task within RuSentRel-1.1 collection, for the following models: conventional approaches (SVM, RandomForest, kNN, NB, Gradient Boosting), CNN-based networks, RNN-based networks, Attentive models, BERT-based language models.

Language Models Application in Sentiment Attitude Extraction Task
Nicolay Rusnachenko
Proceedings of the Institute for System Programming of the RAS (Proceedings of ISP RAS), vol.33
Russia, Moscow, August 9'th, 2021
(Journal Paper)
doi / original-paper / attention-analysis / workflow-code / networks-code / bert-code

This lecture is devoted to the works that were done within last 4 years, which is related sentiment attitude extraction task.

AREkit toolkit for sentiment attitude extraction from news texts
Zoom meeting, September 9'th, 2021
(Talk, meeting)
slides

Advances in Sentiment Attitude Extraction Task
Nicolay Rusnachenko
Introduction to Humanistic Informatics course
Denmark, Odense, November 26'th, 2020
(Online Lecture)
video / slides

This lecture is devoted to the works that were done within last 4 years, which is related sentiment attitude extraction task.

10-th Lisbon Machine Learning Summer School
Portugal, Lisbon, July 21-29, 2020
(Summer School)
certificate

Participant of summer school.

Attention-Based Neural Networks for Sentiment Attitude Extraction using Distant Supervision
Nicolay Rusnachenko, Natalia Loukachevitch
The 10th International Conference on Web Intelligence, Mining and Semantics (WIMS 2020), June 30-July 3 (arXiv:2006.13730)
France, Biarritz, 2020
(Oral Presentation)
video / bibtex / preprint-arXiv / code / slides

Application of Distant Supervision in model training process results in a weight distribution biasing: frames in between subject and object of attitude got more weight values; the latter reflects the pattern of frame-based approach, utilized in RuAttitudes collection development.

Studying Attention Models in Sentiment Attitude Extraction Task
Nicolay Rusnachenko, Natalia Loukachevitch
Proceedings of the 25th International Conference on Natural Language and Information Systems NLDB 2020. Lecture Notes in Computer Science, vol 12089. Springer, Cham (arXiv:2006.11605)
Germany, Saarbrücken, 2020
(Oral Presentation)
bibtex / preprint-arXiv / code / slides

Sentiment Frames for Attitude Extraction in Russian
Natalia Loukachevitch, Nicolay Rusnachenko
Proceedings of International Conference on Computational Linguistics and Intellectual Technologies Dialogue-2020 (arXiv:2006.10973)
Russia, Moscow, 2020
(Oral Presentation)
bibtex / ru-senti-frames / slides

Provides a description of the developed RuSentiFrames lexicon with the related application for attitude extraction

Automatic Sentiment Attitude Extraction via Neural Networks
Natalia Loukachevitch, Nicolay Rusnachenko
Conversations Conference
Moscow, Loft Hall, 26'th November, 2019
(Oral Presentation by supervisor)
slides[rus]

Automatic Extraction of Implicit Attitudes From Texts
Natalia Loukachevitch, Karnaukhova V.A., Nicolay Rusnachenko
Tatarstan Academy of Sciences, 2018
(Plenary)
bibtex[rus] / paper / proceeding

Pages: 169-179. The paper describes the task of automatic extraction of attitudes between the subjects mentioned in the text, as well as their connection with the implicit expression of the author's attitude to these subjects. A RuSentiFrames vocabulary is presented, in which the basic attitudes associated of Russian predicate words are described.

Introduction into Recurrent Neural Networks and Convolutional Neural Networks Moscow, Bauman Moscow State Technical University (BMSTU), October, 2019
slides[rus] / cnn-example
Lecture extra materials (English):
rnn-backprop / optimizers-overview

Distant Supervision for Sentiment Attitude Extraction
Nicolay Rusnachenko, Natalia Loukachevitch, Elena Tutubalina
First Athens Natural Language Processing Summer School
Greece, Athens, September 18-26, 2019
(Poster Presentation)
poster / certificate / labs / slides
(Summer School)

Participant of summer school.

Distant Supervision for Sentiment Attitude Extraction
Nicolay Rusnachenko, Natalia Loukachevitch, Elena Tutubalina
Proceedings of Recent Advances in Natural Language Processing Conference
Bulgaria, Varna, 2019
(Poster Presentation)
bibtex / code / ru-attitudes / ru-senti-frames / poster / proceedings

First time application of automatic attitudes extraction from raw news, based on news title presentation simplicity.

Neural Network Approach for Extracting Aggregated Opinions from Analytical Articles
Nicolay Rusnachenko, Natalia Loukachevitch
International Conference on Data Analytics and Management in Data Intensive Domains, Springer, 2018
bibtex / code

Utilizing a set of sentence level attitudes with related metrics to perform a sentiment prediction. As for input of neural network based models, in prior works all the models deals with an attitudes limited by a single sentence.

Extracting Sentiment Attitudes from Analytical Texts via Piecewise Convolutional Neural Network
Nicolay Rusnachenko, Natalia Loukachevitch
DAMDID-2018, CEUR Workshop Proceedings (ceur-ws.org)
Russia, Moscow (MSU), 2018
(Oral Presentation), (Poster Presentation)
bibtex / code / slides / poster

An application of CNN based architecture (adapted for relation extraction) towards sentiment attitudes extraction task.

Using Convolutional Neural Networks for Sentiment Attitude Extraction from Analytical Texts
Nicolay Rusnachenko, Natalia Loukachevitch
EPiC Series in Language and Linguistics 4, 1-10, 2019
bibtex / code / slides / poster

An application of CNN based architecture (adapted for relation extraction) towards sentiment attitudes extraction task. Presented at Third Workshop "Computational linguistics and language science" (CCLS-2018), HSE, Moscow.

Extracting Sentiment Attitudes from Analytical Texts
Natalia Loukachevitch, Nicolay Rusnachenko
Proceedings of International Conference on Computational Linguistics and Intellectual Technologies Dialogue-2018 (arXiv:1808.08932)
Russia, Moscow, 2018
(Oral Presentation)
bibtex / dataset / code / slides[1] / slides[2]

The first approach, i.e introduction of sentiment attitudes extraction task. Includes developed dataset with related experiments.

Sentiment Attitudes and Their Extraction from Analytical Texts
Nicolay Rusnachenko, Natalia Loukachevitch
International Conference on Text, Speech, and Dialogue (TSD)
Czech Republic, Brno, 2018
(Oral Presentation)
bibtex / dataset / code / slides

Introduction of sentiment attitudes extraction task. Includes developed dataset with related experiments.

Methods of Lexicon Integration with Machine Learning for Sentiment Analysis System
Nicolay Rusnachenko, Natalia Loukachevitch
Artificial Intelligence and decision making (AIDM) journal, ISSN 2071-8594, 2017
(Best Student Paper Award at DIALOGUE-2016),
(Poster Presentation)
bibtex / poster / certificate / code

Provides details on lexicon development using twitter messages (related works [pmi], [dev], [sota]). Sentiment classification of user reviews using SVM. Master degree paper.

Extracting Sentiment Attitudes from Analytical Texts via Piecewise Convolutional Neural Network
Russia, Kazan, Kazan Federal University, 2018
(Poster Presentation)
poster / certificate

Methods of Lexicon Integration with Machine Learning for Sentiment Analysis System
Russia, Saratov, SGU, 2016
Russia, Yekaterinburg, 2017
(Poster Presentation)
poster / certificate

This guy shares a great template!