By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
World of SoftwareWorld of SoftwareWorld of Software
  • News
  • Software
  • Mobile
  • Computing
  • Gaming
  • Videos
  • More
    • Gadget
    • Web Stories
    • Trending
    • Press Release
Search
  • Privacy
  • Terms
  • Advertise
  • Contact
Copyright © All Rights Reserved. World of Software.
Reading: Limitations of Current Biomedical Text Mining Community Challenges | HackerNoon
Share
Sign In
Notification Show More
Font ResizerAa
World of SoftwareWorld of Software
Font ResizerAa
  • Software
  • Mobile
  • Computing
  • Gadget
  • Gaming
  • Videos
Search
  • News
  • Software
  • Mobile
  • Computing
  • Gaming
  • Videos
  • More
    • Gadget
    • Web Stories
    • Trending
    • Press Release
Have an existing account? Sign In
Follow US
  • Privacy
  • Terms
  • Advertise
  • Contact
Copyright © All Rights Reserved. World of Software.
World of Software > Computing > Limitations of Current Biomedical Text Mining Community Challenges | HackerNoon
Computing

Limitations of Current Biomedical Text Mining Community Challenges | HackerNoon

News Room
Last updated: 2025/04/25 at 9:58 AM
News Room Published 25 April 2025
Share
SHARE

Table of Links

Abstract and 1. Introduction

2. Community Challenges Overview and 2.1 CCKS

2.2 CHIP and 2.3 CCIR, CSMI, CCL and DCIC

3. Evaluation Tasks Overview and 3.1 Information Extraction

3.2 Text Classification and Text Similarity

3.3 Knowledge Graph and Question Answering

3.4 Text Generation and Knowledge Reasoning and 3.5 Large Language Model Evaluation

4. Translational Informatics in Biomedical Text Mining

5. Discussion and Perspective

5.1. Contributions of Community Challenges

5.2. Limitations of Current Community Challenges

5.3. Future Perspectives in the Era of Large Language Models, and References

Figure Legends and Tables

There are some limitations in current community challenge evaluation tasks on biomedical text mining.

Firstly, there is a lack of representativeness of data in evaluation tasks. Biomedical and healthcare data possess sensitivity and privacy concerns, making it difficult to obtain largescale datasets. This results in many tasks using small or synthetic datasets, which may limit the representativeness and applicability. Data quality and annotation are also challenging, as the annotation of medical data are complex and requires high levels of expertise from annotators. For data types, many tasks only collect a single type of data. In the future, task organizer should consider incorporating data from multiple sources and modalities. Additionally, some datasets are restricted for use only during the evaluations and not made available afterward, limiting the impact of community challenge evaluation tasks.

Secondly, the developed solutions may lack sufficient innovation and exhibit poor reproducibility. Some participants tend to apply established methods to achieve quick results, rather than exploring novel and innovative approaches. This can lead to a lack of innovation and diversity in methods, limiting further technical advancements. On the other hand, some algorithms may perform well on specific datasets but fail to generalize to others, reducing their broad applicability and reliability. To encourage innovation, future community challenges should emphasize the exploration of novel techniques and reward participants for their creativity. When integrating with existing systems, algorithm performance must be evaluated across multiple datasets and scenarios to ensure robustness and generalizability.

Lastly, there exists a gap between evaluation tasks and applications in clinical practice. These tasks are generally abstracted from complex real-world problems and simplified to facilitate evaluation and comparison. However, such simplification may not reflect the complexity, diversity, and ambiguity of problems in real-world clinical settings. For example, several tasks focus on fundamental NLP tasks, such as medical information extraction and text classification, while more intricate challenges closely aligned with clinical practice are lacking. In real-world clinical practice, models always need to handle more noise and uncertainty, which may not have been fully considered in current evaluation tasks. Therefore, even systems that perform well in evaluation tasks may not be able to achieve similar results in practical applications.

Authors:

(1) Hui Zong, Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease related Molecular Network, West China Hospital, Sichuan University, Chengdu, 610041, China and the author contributed equally;

(2) Rongrong Wu, Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease related Molecular Network, West China Hospital, Sichuan University, Chengdu, 610041, China and the author contributed equally;

(3) Jiaxue Cha, Shanghai Key Laboratory of Signaling and Disease Research, Laboratory of Receptor-Based Bio-Medicine, Collaborative Innovation Center for Brain Science, School of Life Sciences and Technology, Tongji University, Shanghai, 200092, China;

(4) Erman Wu, Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease related Molecular Network, West China Hospital, Sichuan University, Chengdu, 610041, China;

(5) Jiakun Li, Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease related Molecular Network, West China Hospital, Sichuan University, Chengdu, 610041, China and Department of Urology, West China Hospital, Sichuan University, Chengdu, 610041, China;

(6) Liang Tao, Faculty of Business Information, Shanghai Business School, Shanghai, 201400, China;

(7) Zuofeng Li, Takeda Co. Ltd., Shanghai, 200040, China;

(8) Buzhou Tang, Department of Computer Science, Harbin Institute of Technology, Shenzhen, 518055, China;

(9) Bairong Shen, Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease related Molecular Network, West China Hospital, Sichuan University, Chengdu, 610041, China and a Corresponding author.

Sign Up For Daily Newsletter

Be keep up! Get the latest breaking news delivered straight to your inbox.
By signing up, you agree to our Terms of Use and acknowledge the data practices in our Privacy Policy. You may unsubscribe at any time.
Share This Article
Facebook Twitter Email Print
Share
What do you think?
Love0
Sad0
Happy0
Sleepy0
Angry0
Dead0
Wink0
Previous Article Cyber attack forces M&S to stop taking orders online sending shares plummeting
Next Article Pay No Interest For Up To 21 Months With These Top Credit Cards
Leave a comment

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Stay Connected

248.1k Like
69.1k Follow
134k Pin
54.3k Follow

Latest News

Here’s everything new Apple TV+ has coming in July – 9to5Mac
News
Gentoo Releases Updated Install Media Based On KDE Plasma 6.3 + Linux 6.12 LTS
Computing
Google kills its Keep app on Apple Watch
News
New app launching TODAY to ping 88m Brits with alerts, digital IDs & benefits
News

You Might also Like

Computing

Gentoo Releases Updated Install Media Based On KDE Plasma 6.3 + Linux 6.12 LTS

1 Min Read
Computing

Xpeng Motors to invest $413 million in flying cars this year: CEO · TechNode

1 Min Read
Computing

Stablecoins could be key in PAPSS’ new blockchain platform

7 Min Read
Computing

20 Notion Travel Templates to Plan Your Next Adventure |

34 Min Read
//

World of Software is your one-stop website for the latest tech news and updates, follow us now to get the news that matters to you.

Quick Link

  • Privacy Policy
  • Terms of use
  • Advertise
  • Contact

Topics

  • Computing
  • Software
  • Press Release
  • Trending

Sign Up for Our Newsletter

Subscribe to our newsletter to get our newest articles instantly!

World of SoftwareWorld of Software
Follow US
Copyright © All Rights Reserved. World of Software.
Welcome Back!

Sign in to your account

Lost your password?