Baraa Al Jorf

Baraa Al Jorf

Advancing Multimodal Foundation Models for Healthcare

+1 (646) 359 2619 (US) +971 50 150 9486 (UAE) baj321@nyu.edu ba2797@columbia.edu LinkedIn

About Me

I’m a PhD researcher at NYU in Computer Science, working on AI systems for healthcare — with a focus on clinical foundation models, multimodal learning, and medical data. My work integrates clinical notes, medical imaging, and EHRs to build machine learning systems that can support diagnosis, risk prediction, and clinical decision-making. Recently, I completed a Visiting PhD semester at Columbia University, where I took advanced coursework in causal inference and foundation model theoretical design. I’ve published research on fusion architectures and clinical benchmarks, presented at international AI and healthcare conferences, and helped lead events like the Clinical AI Bootcamp and Healthcare AI Summit. Open to research collaborations, clinical-AI roles, and opportunities that connect machine learning with real-world healthcare impact.

Education

PhD in Computer Science, New York University 9/2023 - Present

  • Expected Graduation: 2028
  • GPA: 3.9/4.0
  • Research Focus: Advancing Multimodal Foundation Models for Healthcare
  • Relevant Coursework:
    • NYU Tandon: Big Data, Algorithmic Machine Learning, AI for Games, Medical Robotics
    • NYU Courant: Natural Language Processing, Advanced Machine Learning
    • NYU Langone: Evaluation Methods for Predictive Risk Methods
    • NYUAD: Clinical AI Lab Readings in CS, Clinical AI Advanced Projects in CS

Visiting PhD Student, Columbia University 1/2025 – 5/2025

  • Attended Fu Foundation School of Engineering in the Inter-University Engineering Doctoral Consortium
  • Completed advanced coursework in Causal Inference, Foundations of Large Language Models

BSc in Computer Engineering, New York University 8/2019 - 5/2023

  • Capstone Project: Design of Navigation Algorithm using Reinforcement learning for library robot
  • GPA: 3.8/4.0
  • Completed coursework in NYU Abu Dhabi (main campus), NYU Tandon, and NYU Tisch
  • Attended international seminars in Prague, Czech Republic (June 2022) | Athens, Greece (Jan 2023)

Research & Publications

Accepted

  • MedPatch: Confidence-Guided Multi-Stage Fusion for Multimodal Clinical Data.
  • Enhancing In-hospital Mortality Prediction using Diverse Ensembles of Multimodal Fusion Networks.
  • MSMA: Multistage Missingness-Aware Fusion Network of Diverse Clinical Modalities for In-hospital Mortality Prediction.
  • MedMod: Multimodal Benchmark for Medical Prediction Tasks with Electronic Health Records and Chest X-Ray Images.
  • Multimodal Contrastive Image-EHR Pre-training Enhances In-hospital Deterioration Prediction.

Under Review

  • Data-centric Guidelines for Designing AI Foundation Models in Medicine.

In Preparation

  • Roadmap towards Generalist AI Foundation Models in Healthcare: Capabilities and Outlook.

Leadership & Experience

Graduate Research Assistant, New York University Abu Dhabi

7/2023 - Present

  • Trained and tested 7 novel fusion architectures using MIMIC-IV, MIMIC-CXR, and MIMIC-IV Notes datasets, achieving improvements in AUROC/AUPRC across evaluation tasks with 3 of them.
  • Benchmarked 6 supervised multimodal architectures and 2 unimodal architectures on 6 tasks using the MIMIC-IV and MIMIC-CXR datasets.
  • Screened 140+ papers for a multimodal foundation model literature review, culminating in 50 papers relevant for data extraction.

Communication Chair, AI Revolution in Healthcare Summit, Clinical AI Lab x Medvarsity

2/2025

  • Managed communication and outreach with 10 UAE universities.
  • Reviewed 20 abstract submissions and selected 8 for a conference poster session.
  • Coordinated with Medvarsity to ensure smooth conference planning and execution.

Moderator, Clinical AI Bootcamp, Clinical AI Lab

11/2024

  • Collaborated with the Clinical AI team to organize a bootcamp attended by 20+ healthcare experts.
  • Developed guidelines for focus group discussions on multimodal data handling in clinical settings.
  • Moderated a focus group session, gathering clinical insights into the challenges and opportunities of clinical AI deployment.

Presenter, ADIA Symposium

11/2024

  • Presented "Advancing Multimodal Foundation Models in Healthcare: A Framework of Guidelines, Reviews, and Novel Architectures" to an audience of global AI researchers and healthcare professionals.
  • Highlighted novel fusion strategies, guidelines for clinical applications, and findings from a comprehensive literature review.

Projects

Effectiveness of Layered Pretraining for Foundation Models

+

Detailed a theoretical framework proving the effect of layered pretraining for Large Language Model encoders for classification tasks and verified our findings empirically.

Link: https://drive.google.com/file/d/11mhJp_Msx4zUxPgk2ZFUxwL6PU1qfYN7/view?usp=sharing

In-Context-Learning with LLMs

+

Developed a GPT-4 based AI agent leveraging in-context learning to improve LLM decision-making. Designed experiments against heuristic bots and human players, achieving up to 80% win rate.

Link: https://drive.google.com/file/d/1bCXZMNmLq2JCUoy0Zwsot6ynd0_C1CTX/view?usp=sharing

Dynamic Hierarchical Fusion

+

Created a novel hierarchical fusion framework incorporating sample-specific fusion of electronic health records, chest x-rays, discharge notes, and radiology reports.

Link: https://drive.google.com/file/d/1PMt3bwZrfIv5uUoF_HosABbdr8RpZDwz/view?pli=1

Art Projects

View this profile on Instagram

BaraaDraws (@baraadraws) • Instagram photos and videos

Awards & Skills

Awards

NYUAD Global PhD Fellowship | 7/2023

- 5-year doctoral fellowship awarded for academic merit

Abu Dhabi Golden Visa | 7/2023

10-year visa awarded for exceptional academic achievement

Skills

Programming:

Python C++ MATLAB Pytorch Tensorflow ROS Bash High Performance Computing

Leadership:

Public Speaking Peer-counselling Active Listening Project Management Multi-tasking

Volunteer Work

Engineers for Social Impact, Urbz- Dharavi Mumbai, India

  • Developed a children's coding curriculum with local company in Dharavi for a daycare center.
  • Produced a film showcasing the challenges faced by 30 interviewed community members.

Special Needs Adaptive Program (SNAP), NYUAD- Abu Dhabi, UAE

  • Volunteered weekly to teach basketball to 15 children with autism and Down syndrome.

Boys Education Network

  • Facilitated 4 leadership workshops for 6 middle school students in Abu Dhabi.
  • Workshops covered a range of topics with emphasis on growing in the new normal enforced by the COVID-19 pandemic.

NYUAD Community Outreach Virtual Tutoring

  • Hosted 10 hours of virtual physics tutoring sessions for 2 high school juniors.
  • Tutored students at the Bangladeshi School in Abu Dhabi.

WeSTEM Mentor

  • Mentored a sophomore through weekly meetings as part of an initiative.
  • Encouraged women to pursue STEM college degrees.

Hala Mondial Volunteer

  • Engaged with students on the autism spectrum and children with Down's syndrome.
  • Celebrated the World Cup and practiced football among other activities.

Student Volunteer, Genesee County Habitat for Humanity

  • Volunteered with Habitat for Humanity to help in building a house.
  • Part of the Engineers for Social Impact program.

Library Assistant, New York University Abu Dhabi

  • Helped in scanning books to digitize them.

Usher, HAY FESTIVAL OF LITERATURE AND THE ARTS LIMITED

  • Ushered for the Hay Festival in Abu Dhabi.
  • Worked in front of the theater and admitted ticket holders.