hunter-lab/sentence-level-ignorance-classifier

Model Card for Model ID

This model is a binary classifier that determines whether a sentence is a statement of ignorance or not.

Model Details

Model Description

• This model consists of a linear classification head on top of BioMedBERT, which is a BERT-based encoder (110 million parameters, 12 layers, 768 hidden).

• All layers besides 10, 11, the pooler, and classificaton head were frozen to reduce overfitting on the small training set.

• Developed by: Nathan Gelfand, Darya Shlyk

• Funded by: Larry Hunter

• Model type: Supervised fine-tune of a transformer-encoder for text classification

• Language(s) (NLP): English

• License: MIT

• Finetuned from model: microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract

Model Sources [optional]

• Repository: [More Information Needed]

Uses

Direct Use

A statement of ignorance, or knowledge gap statement, is a piece of text indicating a lack of knoweldge on some subject. In the field of biomedical research, knowledge gap statements often indicate unanswered questions, which can be useful for researchers looking for new topics of study. We built this sentence-level binary classifier so that researchers could parse through biomedical papers to identify research directives.

Downstream Use [optional]

[More Information Needed]

Out-of-Scope Use

[More Information Needed]

Bias, Risks, and Limitations

This model was trained on a dataset of 937 annotated statements from articles about monogenic epilepsies. Due to the small dataset size, it is possible that the classifier will perform better on statements related to monogenic epilepsies.

We defined a statement of ignorance using the guidelines below.

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

Use the code below to get started with the model.

!pip install transformers 
from transformers import pipeline

classifier = pipeline("text-classification",model="hunter-lab/sentence-level-ignorance-classifier")

sentence = "Consequently, there is a pressing need to enhance basic mechanistic and clinical studies, with a focus on individual differences, to advance the exploration of BCAAs in treating neurological disorders and to provide more robust evidence supporting their clinical applications."

result = classifier(sentence)

print(result)

Training Details

Training Data

[More Information Needed]

Training Procedure

Preprocessing [optional]

[More Information Needed]

Training Hyperparameters

• Training regime: [More Information Needed]

Speeds, Sizes, Times [optional]

[More Information Needed]

Evaluation

Testing Data, Factors & Metrics

Testing Data

[More Information Needed]

Factors

[More Information Needed]

Metrics

[More Information Needed]

Results

[More Information Needed]

Summary

Model Examination [optional]

[More Information Needed]

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

• Hardware Type: [More Information Needed]
• Hours used: [More Information Needed]
• Cloud Provider: [More Information Needed]
• Compute Region: [More Information Needed]
• Carbon Emitted: [More Information Needed]

Technical Specifications [optional]

Model Architecture and Objective

[More Information Needed]

Compute Infrastructure

[More Information Needed]

Hardware

[More Information Needed]

Software

[More Information Needed]

Citation [optional]

BibTeX:

[More Information Needed]

APA:

[More Information Needed]

Glossary [optional]

[More Information Needed]

More Information [optional]

[More Information Needed]

Model Card Authors [optional]

[More Information Needed]

Model Card Contact

[More Information Needed]