[AISWorld] EVALITA 2023 - Call for Interest

[Marco Polignano]

(Apologies for cross-posting)

-----------------------------------------------------------------------------------------

EVALITA 2023

Evaluation of NLP and Speech Tools for Italian

-----------------------------------------------------------------------------------------

****EVALITA 2023 - Call for Interest****

Following the success of the previous editions, we are pleased to 
announce EVALITA 2023, the eighth evaluation campaign of Natural 
Language Processing and Speech tools for Italian.

The general objective of EVALITA (http://www.evalita.it 
<http://www.evalita.it/>) is to promote the development of language 
technologies for the Italian language, providing a shared framework 
where different systems and approaches can be evaluated in a consistent 
manner. EVALITA is an initiative of theItalian Association for 
Computational Linguistics <http://www.ai-lc.it/>(AILC).

In the context of EVALITA 2023 we are organising the following tasks 
(https://www.evalita.it/campaigns/evalita-2023/tasks/ 
<https://www.evalita.it/campaigns/evalita-2023/tasks/>):

  * *DisCoTEX: *Assessing DIScourse COherence in Italian TEXts.
    (https://sites.google.com/view/discotex/home?pli=1
    <https://sites.google.com/view/discotex/home?pli=1>)
  * *EMit 2022:*Categorical Emotion Detection in Italian Social Media
    (http://www.di.unito.it/~tutreeb/emit23/index.html
    <http://www.di.unito.it/~tutreeb/emit23/index.html>).
  * *HODI: *Homotransphobia Detection in Italian.
    (https://hodi-evalita.github.io/ <https://hodi-evalita.github.io/>)
  * *ACTI: *Automatic Conspiracy Theory Identification.
    (https://russogiuseppe.github.io/ACTI/
    <https://russogiuseppe.github.io/ACTI/>)
  * *WiC-ITA: *Word in Context for Italian. (https://wic-ita.github.io/
    <https://wic-ita.github.io/>)
  * *GeoLingIt: *Geolocation of Linguistic Variation in Italy.
    (https://sites.google.com/view/geolingit
    <https://sites.google.com/view/geolingit>)
  * *LangLearn: *Language Learning Development.
    (https://sites.google.com/view/langlearn2023?pli=1
    <https://sites.google.com/view/langlearn2023?pli=1>)
  * *MULTI-Fake-DetectiVE: *MULTImodal Fake News Detection and
    VErification.
    (https://sites.google.com/unipi.it/multi-fake-detective/home
    <https://sites.google.com/unipi.it/multi-fake-detective/home>)
  * *NERMuD: *Named-Entities Recognition on Multi-Domain Documents.
    (https://nermud.fbk.eu/ <https://nermud.fbk.eu/>)
  * *Haspeede3:*Political and Religious Hate Speech Detection.
    (https://di.unito.it/haspeede23 <https://di.unito.it/haspeede23>)
  * *CLinkaRT:*Linking a Lab Result to its Test Event in the Clinical
    Domain. (https://e3c.fbk.eu/clinkart <https://e3c.fbk.eu/clinkart>)
  * *PoliticIT: *PoliticIT. Political ideology detection in Italian
    texts.(https://codalab.lisn.upsaclay.fr/competitions/8507
    <https://codalab.lisn.upsaclay.fr/competitions/8507>)
  * *EmotivITA: *Dimensional and Multi-dimensional emotion analysis.
    (https://sites.google.com/view/emotivita
    <https://sites.google.com/view/emotivita>)

As with other international evaluation campaigns, guidelines describing 
the different tasks will be distributed among the participants.

Participants to the tasks will also be provided with training data and 
will have the chance to test their systems according to the metrics and 
procedures to be used in the formal evaluation.

The results of the evaluation will be disseminated at the final 
workshop, which will be organised in Parma on *7th-8th September 2023*.

We encourage participation from both academic institutions and 
industrial organisations. Please visit the EVALITA web site where 
information about all tasks is currently available, and indicate your 
intention to participate and the specific task(s) you are interested in. 
You can do so by filling out the form at the following link, which will 
be available until *April 30th 2023*:

https://forms.gle/TW2NveAZMZodF7Z59 <https://forms.gle/TW2NveAZMZodF7Z59>

Your expression of interest is not at all binding and you can 
participate in any of the tasks, but it’s very important to us to best 
organise this evaluation campaign.

IMPORTANT DATES:

  * *February 7th, 2023*: release of training data
  * *May 2nd-9th, 2023*: first evaluation window
  * *May 7th-14th, 2023*: second evaluation window
  * *May 12th-19th, 2023*: third evaluation window
  * *May 30th, 2023*: results to participants
  * *June 14th, 2023*: submission of participants’ report
  * *July 10th, 2023*: reviews to participants
  * *July 25th, 2023*: camera ready
  * *September 7th-8th, 2023*: workshop

EVALITA 2023 Chairs:

  * Mirko Lai (Università di Torino)
  * Stefano Menini (Fondazione Bruno Kessler)
  * Marco Polignano (Università di Bari Aldo Moro)
  * Valentina Russo (Logogramma SRL)
  * Rachele Sprugnoli (Università degli Studi di Parma)
  * Giulia Venturi (Istituto di Linguistica Computazionale “A. Zampolli”
    – CNR)

Contact:

evalita2023[AT]gmail.com

FOLLOW US!

Twitter: @EVALITAcampaign