Skip to content

jeongawon/Visual-Impairment-Assistance-AI

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

2 Commits
Β 
Β 

Repository files navigation

Visual-Impairment-Assistance-AI

πŸ‘οΈ μ‹œκ°μž₯애인 보행 μžμœ¨μ„± ν–₯상을 μœ„ν•œ AI 보쑰 μ‹œμŠ€ν…œ (AI Walking Assistant) 이 ν”„λ‘œμ νŠΈλŠ” μ‹œκ°μž₯μ• μΈμ˜ μ•ˆμ „ν•˜κ³  독립적인 보행을 돕기 μœ„ν•΄ 개발된 μ‹€μ‹œκ°„ μœ„ν—˜ 감지 및 μŒμ„± μ•ˆλ‚΄ μ‹œμŠ€ν…œμž…λ‹ˆλ‹€. 카메라 μ˜μƒμ„ 톡해 μ „λ°©μ˜ 객체λ₯Ό νƒμ§€ν•˜κ³ , 거리λ₯Ό μΈ‘μ •ν•˜λ©°, 상황을 λΆ„μ„ν•˜μ—¬ μ‚¬μš©μžμ—κ²Œ μŒμ„±(TTS)으둜 μ•ˆλ‚΄ν•©λ‹ˆλ‹€. πŸ“Œ μ£Όμš” κΈ°λŠ₯ (Key Features)

  1. μ‹€μ‹œκ°„ 객체 탐지 (Object Detection): β—¦ YOLOv5λ₯Ό μ‚¬μš©ν•˜μ—¬ μ‚¬λžŒ, μ°¨λŸ‰(μžλ™μ°¨, λ²„μŠ€, 트럭), μžμ „κ±°, μ‹ ν˜Έλ“± 등을 μ‹€μ‹œκ°„μœΌλ‘œ μΈμ‹ν•©λ‹ˆλ‹€.
  2. 거리 μΆ”μ • (Depth Estimation): β—¦ MiDaS λͺ¨λΈμ„ 톡해 단일 카메라(Webcam)만으둜 κ°μ²΄μ™€μ˜ μƒλŒ€μ  거리λ₯Ό μΈ‘μ •ν•˜μ—¬ "맀우 κ°€κΉŒμ›€/주의/μ•ˆμ „" 단계λ₯Ό νŒλ³„ν•©λ‹ˆλ‹€.
  3. 동적 이동 λ°©ν–₯ 뢄석 (Movement Analysis): β—¦ 이전 ν”„λ ˆμž„κ³Όμ˜ μ’Œν‘œ λ³€ν™”(Ξ”x)λ₯Ό λΆ„μ„ν•˜μ—¬ μ°¨λŸ‰μ΄λ‚˜ μ‚¬λžŒμ΄ λ‹€κ°€μ˜€λŠ”μ§€, λ©€μ–΄μ§€λŠ”μ§€, 쒌우둜 μ΄λ™ν•˜λŠ”μ§€λ₯Ό νŒλ‹¨ν•©λ‹ˆλ‹€.
  4. μ‹ ν˜Έλ“± 색상 인식 (Traffic Light Recognition): β—¦ YOLOκ°€ νƒμ§€ν•œ μ‹ ν˜Έλ“± μ˜μ—­μ˜ RGB 평균값을 λΆ„μ„ν•˜λŠ” μ•Œκ³ λ¦¬μ¦˜(Rule-based)을 μ μš©ν•˜μ—¬ λΉ¨κ°„λΆˆ/μ΄ˆλ‘λΆˆμ„ μ •ν™•νžˆ κ΅¬λΆ„ν•©λ‹ˆλ‹€.
  5. μŒμ„± μ•ˆλ‚΄ 및 μ œμ–΄ (TTS & STT): β—¦ gTTSλ₯Ό 톡해 "전방에 μ°¨λŸ‰μ΄ μ ‘κ·Ό μ€‘μž…λ‹ˆλ‹€"와 같은 κ²½κ³  λ©”μ‹œμ§€λ₯Ό 좜λ ₯ν•©λ‹ˆλ‹€. β—¦ μ‚¬μš©μžμ˜ μŒμ„± λͺ…λ Ή("μ’…λ£Œν•΄", "상황 μ•Œλ €μ€˜")으둜 μ‹œμŠ€ν…œμ„ μ œμ–΄ν•  수 μžˆμŠ΅λ‹ˆλ‹€. πŸ› οΈ 기술 μŠ€νƒ (Tech Stack) β€’ Language: Python 3.8+ β€’ Computer Vision: OpenCV, PyTorch β€’ AI Models: β—¦ YOLOv5 (Object Detection) β—¦ MiDaS (Monocular Depth Estimation) β€’ Audio Interface: β—¦ gTTS (Text-to-Speech) β—¦ SpeechRecognition (Speech-to-Text) β—¦ Pyaudio, Playsound

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors