Senior NLP Scientist - NBME

POSITION OVERVIEW

The Office of Research Strategy (ORS) at NBME ® is currently seeking a Senior NLP Scientist. In The ORS, we develop next-generation assessments of healthcare professionals and conduct research related to these assessments. Areas of research and development include the application of data science (Natural Language Processing/Machine Learning) to problems in educational measurement and test development such as technology assisted text scoring and automated item generation, modeling of process data, simulations and serious games, and applied collaborative research at the intersection between data science, psychometrics, and measurement science in education and credentialing of healthcare professionals.

The Senior NLP Scientist role will apply strong technical and analytical skills to the research and development of novel assessments of healthcare professionals. The ideal candidate is a scholar interested in an exciting and productive research environment that allows for the development of expertise in cutting-edge educational technology.

This role has been designated as primarily remote which means it generally does not require onsite work more than an average of 4 times a quarter and may require additional prescheduled onsite work. Options to work in-person in Philadelphia or hybrid are also available.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the health care community. This commitment starts with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community, and the broader medical education landscape.

RESPONSIBILITIES

• Lead and develop programs of research aligned with the NBME's research agenda that center around the development of novel assessments and adaptation of scientific methods from Natural Language Processing/Machine Learning and data science to measurement. These will include foundational research and the development of prototypes and new products.
• Be a subject matter expert on Natural Language Processing/Machine Learning and collaborate with a diverse team of data scientists, measurement scientists, software developers, marketing experts, business developers, and other stakeholders.
• Contribute to the scientific community via publications and presentations at top-tier venues in Natural Language Processing/Machine Learning, computer science, and measurement science.
• Provide mentoring for junior NBME staff and team members

QUALIFICATIONS

Skills and Abilities

• Background and 5+ years of work experience in natural language processing, machine learning, data science and/or computer science
• Proficiency in Python and/or other programming languages
• Experience in conducting research studies and publishing findings at top-tier conferences and journals in NLP (e.g., ACL, EMNLP, NAACL) or related fields.
• Experience in transitioning research projects from proof of concept into operational applications
• Excellent oral and written communication skills as well as outstanding interpersonal skills, including the ability to work closely and successfully with individuals from a variety of professional and educational backgrounds.

Education

• PhD in Natural Language Processing /computational linguistics, computer science, clinical informatics, or a related discipline

About NBME:

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators, and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, external researchers, and health profession organizations.

We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME® Subject Examinations, Customized Assessment Services, Self-Assessments, the International Foundations of Medicine® Program and Item Writing Workshops. Together with the Federation of State Medical Boards, NBME develops and manages the United States Medical Licensing Examination®, which measures the ability to apply knowledge and skills that form the basis of safe and effective patient care. Our Competency-based Assessment unit is focused on new methods as well as the optimization of assessment in the workplace and education.

As a result of leadership in ongoing research, innovative measurement practices and the exploration of forward-thinking assessment modalities and improvements, NBME advances assessment science. Our grant and funding opportunities further support this dedication to medical education and assessment science. We help develop the next generation of assessment professionals through our Summer Psychometric Internship Program. Through the Stemmler Fund, Strategic Educators Enhancement Fund and Latin America Grants Program, researchers and educators can continue to improve the assessment of health care professionals around the world.

NBME views diversity, equity and inclusion (DEI) as foundational and enduring to our strategy and vision. We continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, culture, products and services, the Philadelphia community and the broader medical education landscape. Our commitment manifests in our hiring and staff development, recruitment for committees, grants programs, design and review of our assessments, and involvement in our local and national communities.

Learn more about NBME at NBME.org.

The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include Healthcare, Dental, Prescription, and Vision plans, 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace.

NBME is an equal opportunity employer as defined by the EEOC.

#LI-Remote

#Senior