200 likes | 214 Views
I4MA Demo. 12. Finish Assessment. 1. Home Page. 2. Snooze. 3. Medicine List. 4. Take Picture. 5. Cancel Take Picture. 6. Picture Preview. 7. Fail Verification. 8. Pass Verification. 9. Additional Info. 10. Take Assessment 1. 11. Take Assessment 2. Flow Chart.
E N D
12. Finish Assessment 1. Home Page 2. Snooze 3. Medicine List 4. Take Picture 5. Cancel Take Picture 6. Picture Preview 7. Fail Verification 8. Pass Verification 9. Additional Info 10. Take Assessment 1 11. Take Assessment 2 Flow Chart Skip verification or go home Back Back Cancel Retry Send Picture Server Verify Image Failed Skip verification or go home Pass Skip Verification Home
Screen 1 Home page for this program, it can receive two types of message: take medicine or take assessment.
Screen 2 Snooze setting.
Screen 3 Medicine List Screen. It will show a short description for each medicine and if there is a dosage change, it will also show a alert message.
Screen 4 Take picture screen.
Screen 5 Skip verification dialog. It show up after user click cancel on take picture screen. It allow user to skip medicine verification or go back to home page.
Screen 6 Picture preview screen. User can choose to send picture or take picture again, skip medicine verification or go to homepage.
Screen 7 Medicine verification successful screen. It will show a brief list of medicines need to take and award user with 100 bonus points.
Screen 8 Failed verification screen. It will show name, picture and dosage of medicines that failed verification. User can choose to skip medicine verification and take medicine or retry to take picture again.
Screen 9 Addition information. It shows up after user click done upon successfully verified medicine or click skip button when verification failed. After this screen, user go to homepage directly.
Screen 10 Take assessment screen 1
Screen 11 Take assessment screen 2
Screen 12 After user click finish, assessment result will be send to server and award user with 50 bonus points. After user click ok, user will go to homepage.
Image Processing • Patients take pictures of pills. • Black rectangle card as reference. • Send picture to the server. • Server does image processing, gets the result.
Pill Detection AnalysisEdge Detection Difference* Kirsh Prewitt Sobel
Pill Detection AnalysisDetection Flow • Pills are found based on clusters. • # of clusters = # of pills + 1. • Noise reduction. • Calculate dimension of the card. • Calculate pill size, maintain pill color. • Display results.
Pill Detection Demo Target Pills: A B C D E F
Limitations • Pictures taken with big angle does not work very well. • Cannot distinguish different pills of the same shape and color. • Background must have uniform color.
Pill Detection AnalysisPossible Improvements • Fine-tune the calculations. • More pill attributes. • Need exact pills. • More advanced algorithms.