[AI/ML] Precision, Recall, AP (Average Precision) ๊ฐ„๋‹จ ์„ค๋ช… | ๊ฐ์ฒด ๊ฒ€์ถœ ์„ฑ๋Šฅ ์ง€ํ‘œ

2023. 12. 8. 16:48ยท๐Ÿ“– Fundamentals/AI & ML
๋ฐ˜์‘ํ˜•

Object Detection(๊ฐ์ฒด ๊ฒ€์ถœ) ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ์„ ์ธก์ •ํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” Precision(์ •๋ฐ€๋„), Recall(์žฌํ˜„์œจ), ๊ทธ๋ฆฌ๊ณ  Average Precision(AP)๋ฅผ ๊ผญ ์•Œ์•„์•ผ ํ•œ๋‹ค. ML๋ฅผ ๊ณต๋ถ€ํ•˜๋‹ค ๋ณด๋ฉด ํ•œ ๋ฒˆ ์ด์ƒ์€ ๊ณต๋ถ€ํ•˜๋Š” ๊ฐœ๋…์ธ๋ฐ, ๋Š˜ ํ—ท๊ฐˆ๋ฆฌ๋Š” ๋ถ€๋ถ„์ด ์žˆ๊ธฐ์— ์ •๋ฆฌํ•ด ๋‘๋ ค ํ•œ๋‹ค. 

 

๊ฐ์ฒด ๊ฒ€์ถœ๊ณผ ์ž‘์—…์—์„œ๋Š” Precision, Recall ๋“ฑ์˜ ๊ฐœ๋…์ด ์ค‘์š”ํ•œ๋ฐ, ๊ทธ ์ด์œ ๋Š” ๊ฐ์ฒด ๊ฒ€์ถœ ์„ฑ๋Šฅ์ด ์ข‹์ง€์•Š์„ ๋•Œ ์˜ค๊ฒ€์ถœ์„ ๋งŽ์ด ํ–ˆ์„ ์ˆ˜๋„ ์žˆ๊ณ , ๊ฒ€์ถœ ์ž์ฒด๊ฐ€ ์ž˜ ์•ˆ๋์„ ์ˆ˜๋„(๋ฏธ๊ฒ€์ถœ) ์žˆ๊ธฐ ๋•Œ๋ฌธ์ด๋‹ค.

 

์ด๊ฒŒ ์™œ ์ค‘์š”ํ• ๊นŒ? ๊ฐ์ฒด ๊ฒ€์ถœ ์ž‘์—…์— ๋”ฐ๋ผ ์˜ค๊ฒ€์ถœ์ด ์น˜๋ช…์ ์ธ ๊ฒฝ์šฐ๋„ ์žˆ๊ณ , ๋ฏธ๊ฒ€์ถœ์ด ์น˜๋ช…์ ์ธ ๊ฒฝ์šฐ๋„ ์žˆ๊ธฐ ๋•Œ๋ฌธ์ด๋‹ค.

 

๋‹ค๋ฅธ ์„ค๋ช…๋“ค์„ ๋ณด๋ฉด True positive, False positive,... ๋“ฑ์˜ ๋ณต์žกํ•œ ๊ฐœ๋…์ด ๋งŽ์€๋ฐ ํ•œ ๋ฒˆ์”ฉ ์ดํ•ด๋Š” ํ•ด์•ผํ•œ๋‹ค. ํ•˜์ง€๋งŒ ๋” ์ค‘์š”ํ•œ ๊ฒƒ์€ precision๊ณผ recall์ด ๋†’๊ณ  ๋‚ฎ์Œ์— ๋”ฐ๋ผ ๋ฌด์—‡์ด ๋‹ค๋ฅธ์ง€๋ฅผ ์ดํ•ดํ•˜๋Š” ๊ฒƒ์ด๋‹ค. ์•„๋ž˜์—์„œ ํ•ด๋‹น ๋‚ด์šฉ์„ ์‚ดํŽด๋ณด์ž.


 

Precision (์ •๋ฐ€๋„)

  • ๋ชจ๋ธ์ด ์–‘์„ฑ์œผ๋กœ ์˜ˆ์ธกํ•œ ๊ฒƒ ์ค‘์—์„œ ์‹ค์ œ๋กœ ์–‘์„ฑ์ธ ๋น„์œจ
  • Precision = (True Positives) / (True Positives + False Positives)
  • Precision↑ : ๋ชจ๋ธ์ด ์˜ˆ์ธกํ•œ ์–‘์„ฑ์ด ๋Œ€๋ถ€๋ถ„ ์‹ค์ œ ์–‘์„ฑ / ์˜ค๊ฒ€์ถœ ์ ์Œ
  • Precision↓ : ๋ชจ๋ธ์ด ์–‘์„ฑ์œผ๋กœ ์˜ˆ์ธกํ•œ ๋Œ€๋ถ€๋ถ„์ด ์‹ค์ œ๋กœ๋Š” ์Œ์„ฑ / ์˜ค๊ฒ€์ถœ ๋‹ค์ˆ˜

 

 

Recall (์žฌํ˜„์œจ)

  • ์‹ค์ œ ์–‘์„ฑ ์ค‘์—์„œ ๋ชจ๋ธ์ด ์ •ํ™•ํ•˜๊ฒŒ ๊ฐ์ง€ํ•œ ๋น„์œจ
  • Recall = (True Positives) / (True Positives + False Negatives)
  • Recall↑ : ๋ชจ๋ธ์ด ๋Œ€๋ถ€๋ถ„์˜ ์‹ค์ œ ์–‘์„ฑ์„ ๊ฐ์ง€ / ๋ฏธ๊ฒ€์ถœ ์ ์Œ
  • Recall↓ : ๋ชจ๋ธ์ด ์‹ค์ œ ์–‘์„ฑ ์ค‘ ์ผ๋ถ€๋ฅผ ๊ฐ์ง€ํ•˜์ง€ ๋ชปํ•œ ๊ฒฝ์šฐ / ๋ฏธ๊ฒ€์ถœ ๋‹ค์ˆ˜

 

precision์ด ๋‚ฎ๋‹ค๋Š” ๊ฒƒ์€ ์˜ค๊ฒ€์ถœ์ด ๋งŽ๋‹ค๋Š” ๊ฒƒ์ด๊ณ , recall์ด ๋‚ฎ๋‹ค๋Š” ๊ฒƒ์€ ๋ฏธ๊ฒ€์ถœ์ด ๋งŽ๋‹ค๋Š” ๊ฒƒ์ด๋‹ค. ๋•Œ๋ฌธ์— ์ผ๋ฐ˜์ ์œผ๋กœ score thresholod์— ๋”ฐ๋ผ precision๊ณผ recall์€ ๋ฐ˜๋น„๋ก€ ๊ด€๊ณ„๊ฐ€ ๋œ๋‹ค. ๋งŽ์ด ๊ฒ€์ถœํ•˜๋‹ค ๋ณด๋ฉด ๋ฏธ๊ฒ€์ถœ์€ ์ ์–ด์ง€์ง€๋งŒ ์˜ค๊ฒ€์ถœ์ด ๋งŽ์•„์ง€๊ณ , ๋ณด์ˆ˜์ ์œผ๋กœ ๊ฒ€์ถœํ•˜๋‹ค๋ณด๋ฉด ์˜ค๊ฒ€์ถœ์€ ์ ์–ด์ง€๋ฏธ๋งŒ ๋ฏธ๊ฒ€์ถœ์ด ๋งŽ์•„์ง€๋‹ˆ๊นŒ. 

๋•Œ๋ฌธ์— ๊ฐ์ฒด ๊ฒ€์ถœ์—์„œ๋Š” precision๊ณผ recall์ด ๋ชจ๋‘ ์ค‘์š”ํ•˜๋‹ค. ๊ทธ๋ ‡๋‹ค๋ฉด ๊ฐ€์žฅ ์ข‹์€ ๋ชจ๋ธ์„ ๊ณ ๋ฅด๊ธฐ ์œ„ํ•ด์„  ์–ด๋–ค ์ง€ํ‘œ๋ฅผ ๋ด์•ผํ• ๊นŒ? ์•„๋ž˜์˜ Average Precision์„ ๋ณด์ž.

 

 

 

 

AP (Average Precision)

  • Precision-Recall ๊ณก์„ (์–‘์„ฑ ์˜ˆ์ธก์˜ Precision๊ณผ Recall ๊ฐ„์˜ ๊ด€๊ณ„๋ฅผ ๋ณด์—ฌ์ฃผ๋Š” ๊ณก์„ ) ์•„๋ž˜์˜ ๋ฉด์ 
  • AP๋Š” ๋ชจ๋ธ์ด ์–ด๋–ค Recall ๊ฐ’์—์„œ ์–ผ๋งˆ๋‚˜ ์ข‹์€ ์„ฑ๋Šฅ์„ ๋ณด์ด๋Š”์ง€๋ฅผ ์ธก์ •ํ•˜๋ฉฐ, ์—ฌ๋Ÿฌ Recall ๊ฐ’์— ๋Œ€ํ•œ AP๋ฅผ ํ‰๊ท ๋‚ด๋ฉด ๋ชจ๋ธ์˜ ์ „๋ฐ˜์ ์ธ ์„ฑ๋Šฅ์„ ์ธก์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.
  • ๋ชจ๋ธ์˜ ์ ์ ˆํ•œ precision-recall ๋น„์œจ์„ ์„ค์ •ํ•˜๊ธฐ ์œ„ํ•ด Score Threshold ๋ฅผ ์„ค์ •ํ•˜๋Š” ๊ณผ์ •์ด ํ•„์š”ํ•œ๋ฐ, ์ด ๊ณผ์ • ์ „์— ์–ด๋–ค ๋ชจ๋ธ ์›จ์ดํŠธ๋ฅผ ์„ ํƒํ• ์ง€๊ฐ€ ์„ ํ–‰๋˜์–ด์•ผ ํ•œ๋‹ค. ์ด ๋•Œ ์ผ๋ฐ˜์ ์œผ๋กœ AP๊ฐ€ ๋†’์€ ๋ชจ๋ธ์„ ์„ ํƒํ•œ๋‹ค.

 

์ด์ฒ˜๋Ÿผ Precision, Recall, AP๋Š” ๊ฐ์ฒด ๊ฒ€์ถœ ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ์„ ์ข…ํ•ฉ์ ์œผ๋กœ ํ‰๊ฐ€ํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์šฉ๋œ๋‹ค. ๊ณ ์ •๋œ Threshold์—์„œ ์ธก์ •๋˜๋Š” Precision๊ณผ Recall์€ ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ์„ ํŠน์ •ํ•œ ์กฐ๊ฑด์—์„œ ํ‰๊ฐ€ํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋˜๋ฉฐ, AP๋Š” ๋ชจ๋ธ์˜ ์„ฑ๋Šฅ์„ ๋‹ค์–‘ํ•œ Threshold ๊ฐ’์—์„œ ํ‰๊ท ํ™”ํ•˜์—ฌ ์ธก์ •ํ•œ ๊ฐ’์ด๋‹ค. AP๊ฐ€ ๋†’์„์ˆ˜๋ก ๋ชจ๋ธ์ด ๋†’์€ precision์™€ recall์„ ๊ฐ€์ง€๊ณ  ์žˆ๋Š” ๊ฒƒ์œผ๋กœ ํ•ด์„๋œ๋‹ค๋Š” ๊ฒƒ์„ ์•Œ์•„๋‘์ž.

๋ฐ˜์‘ํ˜•

'๐Ÿ“– Fundamentals > AI & ML' ์นดํ…Œ๊ณ ๋ฆฌ์˜ ๋‹ค๋ฅธ ๊ธ€

[AI/ML] ๋”ฅ๋Ÿฌ๋‹์—์„œ์˜ ํ™•๋ฅ  ๋ถ„ํฌ : ๋ฐ์ดํ„ฐ ๋ชจ๋ธ๋ง๊ณผ ์„ฑ๋Šฅ ๊ฐœ์„ ์„ ์œ„ํ•œ ํ•ต์‹ฌ ๊ฐœ๋…  (0) 2023.12.09
[AI/ML] Precision์ด ์ค‘์š”ํ•œ ๊ฒฝ์šฐ์™€ Recall์ด ์ค‘์š”ํ•œ ๊ฒฝ์šฐ  (0) 2023.12.08
[AI/ML] CNN์—์„œ Convolutional layer์˜ ๊ฐœ๋…๊ณผ ์˜๋ฏธ | ์ปจ๋ณผ๋ฃจ์…˜ ์‹ ๊ฒฝ๋ง | ํ•ฉ์„ฑ๊ณฑ ์‹ ๊ฒฝ๋ง  (3) 2023.03.23
[AI/ML] ๋”ฅ๋Ÿฌ๋‹ ์ •๊ทœํ™” Regularization : Weight Decay, Batch Normalization, Early Stopping  (0) 2022.03.23
[AI/ML] Cross Entropy( + Loss) & MSE Loss ์„ค๋ช…  (0) 2022.03.23
'๐Ÿ“– Fundamentals/AI & ML' ์นดํ…Œ๊ณ ๋ฆฌ์˜ ๋‹ค๋ฅธ ๊ธ€
  • [AI/ML] ๋”ฅ๋Ÿฌ๋‹์—์„œ์˜ ํ™•๋ฅ  ๋ถ„ํฌ : ๋ฐ์ดํ„ฐ ๋ชจ๋ธ๋ง๊ณผ ์„ฑ๋Šฅ ๊ฐœ์„ ์„ ์œ„ํ•œ ํ•ต์‹ฌ ๊ฐœ๋…
  • [AI/ML] Precision์ด ์ค‘์š”ํ•œ ๊ฒฝ์šฐ์™€ Recall์ด ์ค‘์š”ํ•œ ๊ฒฝ์šฐ
  • [AI/ML] CNN์—์„œ Convolutional layer์˜ ๊ฐœ๋…๊ณผ ์˜๋ฏธ | ์ปจ๋ณผ๋ฃจ์…˜ ์‹ ๊ฒฝ๋ง | ํ•ฉ์„ฑ๊ณฑ ์‹ ๊ฒฝ๋ง
  • [AI/ML] ๋”ฅ๋Ÿฌ๋‹ ์ •๊ทœํ™” Regularization : Weight Decay, Batch Normalization, Early Stopping
๋ญ…์ฆค
๋ญ…์ฆค
AI ๊ธฐ์ˆ  ๋ธ”๋กœ๊ทธ
    ๋ฐ˜์‘ํ˜•
  • ๋ญ…์ฆค
    CV DOODLE
    ๋ญ…์ฆค
  • ์ „์ฒด
    ์˜ค๋Š˜
    ์–ด์ œ
  • ๊ณต์ง€์‚ฌํ•ญ

    • โœจ About Me
    • ๋ถ„๋ฅ˜ ์ „์ฒด๋ณด๊ธฐ (198)
      • ๐Ÿ“– Fundamentals (33)
        • Computer Vision (9)
        • 3D vision & Graphics (6)
        • AI & ML (15)
        • NLP (2)
        • etc. (1)
      • ๐Ÿ› Research (64)
        • Deep Learning (7)
        • Image Classification (2)
        • Detection & Segmentation (17)
        • OCR (7)
        • Multi-modal (4)
        • Generative AI (6)
        • 3D Vision (2)
        • Material & Texture Recognit.. (8)
        • NLP & LLM (11)
        • etc. (0)
      • ๐ŸŒŸ AI & ML Tech (7)
        • AI & ML ์ธ์‚ฌ์ดํŠธ (7)
      • ๐Ÿ’ป Programming (85)
        • Python (18)
        • Computer Vision (12)
        • LLM (4)
        • AI & ML (17)
        • Database (3)
        • Apache Airflow (6)
        • Docker & Kubernetes (14)
        • ์ฝ”๋”ฉ ํ…Œ์ŠคํŠธ (4)
        • C++ (1)
        • etc. (6)
      • ๐Ÿ’ฌ ETC (3)
        • ์ฑ… ๋ฆฌ๋ทฐ (3)
  • ๋งํฌ

  • ์ธ๊ธฐ ๊ธ€

  • ํƒœ๊ทธ

    ํŒŒ์ด์ฌ
    ๋„์ปค
    Text recognition
    material recognition
    Image Classification
    AI
    Computer Vision
    segmentation
    CNN
    multi-modal
    pandas
    ๋”ฅ๋Ÿฌ๋‹
    3D Vision
    VLP
    nlp
    Python
    OpenCV
    object detection
    ๊ฐ์ฒด ๊ฒ€์ถœ
    ํ”„๋กฌํ”„ํŠธ์—”์ง€๋‹ˆ์–ด๋ง
    OCR
    ๊ฐ์ฒด๊ฒ€์ถœ
    LLM
    GPT
    airflow
    ์ปดํ“จํ„ฐ๋น„์ „
    pytorch
    ChatGPT
    deep learning
    OpenAI
  • ์ตœ๊ทผ ๋Œ“๊ธ€

  • ์ตœ๊ทผ ๊ธ€

  • hELLOยท Designed By์ •์ƒ์šฐ.v4.10.3
๋ญ…์ฆค
[AI/ML] Precision, Recall, AP (Average Precision) ๊ฐ„๋‹จ ์„ค๋ช… | ๊ฐ์ฒด ๊ฒ€์ถœ ์„ฑ๋Šฅ ์ง€ํ‘œ
์ƒ๋‹จ์œผ๋กœ

ํ‹ฐ์Šคํ† ๋ฆฌํˆด๋ฐ”