We have proposed a multimodal approach. Where we first took the best unimodal for textual and visual data classification by testing and automation process. Then we fusion of the two models which can successfully classify the materials that have been damaged using the image and text data. EfficientNetB3+BERT multimodal better accuracy with 94.18%
git clone https://github.com/SalehAhmedShafin/Multimodal-Disaster-Event-Identification-from-Social-Media-Posts.gitThis skill uses multimodal machine learning to classify disaster events from paired social media images and tweets. It processes visual and textual data simultaneously through separate feature extraction paths—EfficientNetB3 for image analysis and BERT for tweet processing—then fuses the results for unified classification. The model achieves 94.18% accuracy across six disaster-related categories including building damage, infrastructure damage, human casualties, and non-damage cases. It handles imbalanced datasets through preprocessing techniques including image scaling, normalization, and augmentation. Organizations responding to disasters can leverage this skill to automatically filter and categorize social media reports for rapid situational awareness.
Automated classification of disaster damage reports from social media during emergency response
Real-time identification of casualty-related posts during natural disasters
Infrastructure damage assessment from crowdsourced image-text social media data
Training disaster management systems on historical disaster event datasets
No install command available. Check the GitHub repository for manual installation instructions.
git clone https://github.com/SalehAhmedShafin/Multimodal-Disaster-Event-Identification-from-Social-Media-PostsCopy the install command above and run it in your terminal.
Launch Claude Code, Cursor, or your preferred AI coding agent.
Use the prompt template or examples below to test the skill.
Adapt the skill to your specific use case and workflow.
Analyze the following social media posts to identify potential disaster events. The posts include both text and images. Use the multimodal approach (EfficientNetB3 for images and BERT for text) to classify the content and determine if it indicates a disaster event. Provide a confidence score for each classification. Posts: [POST1], [POST2], [POST3]
# Disaster Event Identification Report ## Post 1 **Text**: "Just saw a huge fire near the industrial area! Smoke is everywhere. #Emergency" **Image**: [Image of smoke and flames] **Classification**: Fire Disaster **Confidence Score**: 92% ## Post 2 **Text**: "Flooding in the city center. Water levels are rising fast. #Help" **Image**: [Image of flooded streets] **Classification**: Flood Disaster **Confidence Score**: 88% ## Post 3 **Text**: "Just a regular day at the park. Weather is nice. #Nature" **Image**: [Image of a park] **Classification**: No Disaster **Confidence Score**: 95%
Serverless cloud platform for AI and data workloads
Monitoring and error resolution for AI systems
Automate your browser workflows effortlessly
Get more done every day with Microsoft Teams – powered by AI
Agentic AI Workflow platform
Connected workspace for docs, wikis, and projects
Take a free 3-minute scan and get personalized AI skill recommendations.
Take free scan