๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
๐Ÿ“– Theory/etc.

์ปดํ“จํ„ฐ ๋น„์ „ & AI ๊ฐœ๋ฐœ์ž ๋ฉด์ ‘ ์งˆ๋ฌธ

by ๋ญ…์ฆค 2022. 5. 15.
๋ฐ˜์‘ํ˜•

์ปดํ“จํ„ฐ ๋น„์ „ & ๋”ฅ๋Ÿฌ๋‹ ์ง๋ฌด๋กœ ์ฑ„์šฉ ๊ณผ์ • ์ค‘ ๊ณผ์ œ ๋ฐ ๋ฉด์ ‘์„ ๋ณด๋ฉด์„œ ๋ฐ›์€ ์งˆ๋ฌธ๋“ค๊ณผ ๋ฌผ์–ด๋ณผ๋งŒํ•œ ์งˆ๋ฌธ๋“ค์„ ์„ž์–ด์„œ ์ •๋ฆฌํ•ฉ๋‹ˆ๋‹ค. ์งˆ๋ฌธ ๋‚ด์šฉ์„ ๊ทธ๋Œ€๋กœ ์ ์œผ๋ฉด ๋ฌธ์ œ๊ฐ€ ๋  ์ˆ˜๋„ ์žˆ๊ธฐ์— ์‹ค์ œ๋กœ ๋ฐ›์€ ์งˆ๋ฌธ์— ๋น„ํ•ด ๋‹ค์†Œ ์‹ฌํ”Œํ•˜๊ฒŒ ์นดํ…Œ๊ณ ๋ฆฌ๋งŒ ์ ๊ฒ ์Šต๋‹ˆ๋‹ค. ๊ทธ๋ฆฌ๊ณ  ์—ฌ๋Ÿฌ ๋ฉด์ ‘์—์„œ ์ค‘๋ณต๋˜๊ฒŒ ๋ฌผ์–ด๋ณด๋Š” ๋ถ€๋ถ„์€ ๊ตต๊ฒŒ ํ‘œ์‹œํ–ˆ์Šต๋‹ˆ๋‹ค.

 

ํšŒ์‚ฌ๋งˆ๋‹ค ๊ฐ ๋ถ„์•ผ๋งˆ๋‹ค ๋‹ค๋ฅด์ง€๋งŒ ๊ต‰์žฅํžˆ ๊ธฐ๋ณธ์ ์ธ ๊ฒƒ ์œ„์ฃผ๋กœ ๋ฌผ์–ด๋ณด๋Š” ๊ณณ๋„ ์žˆ๊ณ , ์•„์ฃผ ๋”ฅํ•˜๊ณ  ์–ด๋ ค์šด ์งˆ๋ฌธ(์ •๋‹ต์ด ์—†๋Š”)์„ ํ•˜๊ฑฐ๋‚˜ ๋‹นํ•ด์— ๋ฐœํ‘œ๋œ ๋…ผ๋ฌธ๊ณผ ๊ทธ ๋…ผ๋ฌธ์˜ ์ฃผ์š” contribution์„ ๋ฌผ์–ด๋ณด๋Š” ๊ณณ๋„ ๋งŽ์Šต๋‹ˆ๋‹ค. ์งˆ๋ฌธ๊ณผ ๊ด€๋ จ๋œ ๋…ผ๋ฌธ์„ ์•ˆ๋ดค์œผ๋ฉด... ์ฒจ ๋“ค์–ด๋ด…๋‹ˆ๋‹ค.. ๋งŒ ๋ฐ˜๋ณตํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค ใ… .

์‚ฌ์‹ค ๋งŽ์€ ์งˆ๋ฌธ๋“ค์ด ์™ธ์›Œ๊ฐ„๋‹ค๊ณ  ํ•ด๊ฒฐ์ด ์•ˆ๋˜๋Š” ๊ฒฝ์šฐ๊ฐ€ ๋งŽ์Šต๋‹ˆ๋‹ค ใ…  

 

+ ์‚ฌ์‹ค ์„์‚ฌ ์ด์ƒ์€ ๊ฐœ์ธ ์—ฐ๊ตฌ์— ๋Œ€ํ•œ ์งˆ๋ฌธ์ด ์ œ์ผ ๋งŽ์€ ๊ฒƒ ๊ฐ™์Šต๋‹ˆ๋‹ค. 
++ ์—ฐ๊ตฌ ์ฃผ์ œ ๋ฐœํ‘œํ•˜๋‹ค๊ฐ€ ๋ฉด์ ‘๊ด€๊ป˜์„œ ์ž˜ ์•„๋Š” ๋ถ€๋ถ„์ด ์žˆ์œผ๋ฉด ๊ทธ ๋ถ€๋ถ„์ด ๋‚ด ์—ฐ๊ตฌ์—์„œ ํฌ๊ฒŒ ์ค‘์š”ํ•˜์ง€ ์•Š๋”๋ผ๋„ ๊ณ„์† ๋ฌผ์–ด๋ณผ ์ˆ˜ ์žˆ์œผ๋‹ˆ... ์ค€๋น„๋ฅผ ์ž˜ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. 

+++ 2022๋…„ 2๋ถ„๊ธฐ ๊ธฐ์ค€

 

๋จธ์‹ ๋Ÿฌ๋‹ / ๋”ฅ๋Ÿฌ๋‹ ๊ธฐ๋ณธ 
  • Backpropagation
  • Regression vs. Classification
  • Supervised / Unsupervised / Semi-supervised Learning
  • Regularziation & Generalization
  • Discrimitive model vs. Generative model
  • Bias, Variance of Network
  • Overfitting vs Underfitting
  • Feature space์—์„œ feature ๊ฐ„์˜ distance ์ธก์ • ๋ฐฉ๋ฒ•
  • CNN, RNN, LSTM
  • Gradient Descent
  • Loss Surface
  • Confidence Score Calibration
  • PCA
  • SVM
  • Feature Reduction
  • Recptive Field

 

ํ™•๋ฅ ํ†ต๊ณ„ / ์„ ํ˜•๋Œ€์ˆ˜ ๊ธฐ๋ณธ
  • Entropy, Cross-Entropy Loss
  • Gaussian Distribution
  • Rank of matrix
  • Null space
  • SVD / Essential matrix์—์„œ SVD ๋กœ camera pose ๊ตฌํ•˜๋Š” ๋ฐฉ๋ฒ•
  • Vector ๋‚ด์ , ์™ธ์ 
  • ๋‘ ๋ฒกํ„ฐ์˜ ๋‚ด๊ฐ์„ ๊ตฌํ•˜๋Š” ๋ฐฉ๋ฒ•

 

Conventional Computer Vision
  • Conventional Vision Feature descriptor - e.g. SIFT, Corner Detector, Edge Detector
  • Feature Matching
  • Image Filter
  • Image Frequency

 

Deep Learning & Computer Vision
  • Image ์ƒ‰์ƒ ํ‘œํ˜„ ๋ฐฉ๋ฒ• - RGB, HSV, YUV
  • Inception module
  • ResNet, Residual Learning
  • Deformable Convolution, Depth-wise separable Convolution, Graph Convolution
  • Self-supervised Learning, Contrastive Learning (SimCLR)
  • Triplet Loss
  • Attention
  • LSTM, GRU, Transformer, Vision Transformer
  • Transformer -> detection, segmentation์— ์ ์šฉ ๋ฐฉ๋ฒ•?
  • Transformer ์—ฐ์‚ฐ๋Ÿ‰ ํ•ด๊ฒฐ ๋ฐฉ๋ฒ•
  • Positional Encoding
  • Non-local operation
  • CLIP Model
  • RCNN, Fast RCNN, Mask RCNN, YOLO
  • Region of Proposal Network
  • Object Detection - Dynamic Head
  • Long Tail Problem(Class Imbalance)
  • Few shot, Zero shot Learning
  • Sham Network
  • Object Tracking
  • Image Retrieval
  • ๋”ฅ๋Ÿฌ๋‹ ๋ชจ๋ธ ์‚ฌ์ด์ฆˆ vs ์ž‘์—… ๋ณต์žก์„ฑ
  • Continual Learning 
  • Multi-task Learning
  • 6 DoF pose Estimation
  • Knowledge Distillation
  • Mixup
  • Augmentation
  • Denosing
  • Super Resolution
  • Auto Encoder , VAE(Variational Auto Encoder)
  • GAN
  • AutoML
  • MLOps
  • ์‹œ๊ณ„์—ด ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๋Š” ๋ฐฉ๋ฒ•. ๊ฑฐ์˜ continuousํ•œ ์‹œ๊ณ„์—ด ๋ฐ์ดํ„ฐ์™€ sparseํ•œ ๋ฐ์ดํ„ฐ๋ฅผ ์–ด๋–ป๊ฒŒ ๋‹ค๋ฅด๊ฒŒ ์ทจ๊ธ‰ํ•  ๊ฒƒ์ธ์ง€?

 

3D Computer Vision / Graphics
  • Camera Parameter
  • Camera Calibration
  • Image Transform
  • Epipolar Geometry
  • Essential matrix, Fundamental matrix 
  • Essential matrix์—์„œ camera pose ๊ตฌํ•˜๋Š” ๋ฐฉ๋ฒ•?
  • Neural Rendering (NeRF)
  • Point cloud
  • ICP Algorithm
  • SLAM / SFM 
  • Monocular VO(Visual Odometry), multi-camera VO
  • Phong Model
  • PBR 
  • Ambient Occlusion
  • BRDF
  • 3D Reconstruction
  • Texture Mapping
  • COLMAP / SFM (Structure From Motion)
  • Bundle adjustment
  • Triangulation

 

ํ”„๋กœ๊ทธ๋ž˜๋ฐ
  • C++ STL 
  • ๋ฆฌ๋ˆ…์Šค
  • ์ž๋ฃŒ๊ตฌ์กฐ
  • Overloading, Overriding
  • CUDA
  • ์ž„๋ฒ ๋””๋“œ ํฌํŒ…
  • Rendering code
  • Call by value, Call by reference
  • Pointer, Smart pointer
  • Github ๋“ฑ์˜ ํ˜‘์—… ํˆด 
  • ์ฝ”๋“œ๋ฆฌ๋ทฐ

 

๊ธฐํƒ€
  • Image Compression(JPEG, MPEG)
  • GIS
  • GPS
  • ๊ฐ€์žฅ ์ตœ๊ทผ์— ๋ณธ ๋…ผ๋ฌธ์„ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”

 

๊ธฐ์ˆ  ๊ณผ์ œ
  • C++ ์•Œ๊ณ ๋ฆฌ์ฆ˜ ์ตœ์ ํ™” (๊ฒฐ๊ณผ ๋ฆฌํฌํŠธ)
  • Object Detection, Semenatic Segmentation ๋“ฑ์˜ ๋”ฅ๋Ÿฌ๋‹ task ์ˆ˜ํ–‰. (๊ฒฐ๊ณผ ๋ฆฌํฌํŠธ ์ œ์ถœํ•˜๋Š” ๊ณณ๋„ ์žˆ๊ณ , + ์บ๊ธ€ ์ฒ˜๋Ÿผ ๋ชจ๋ธ ์—…๋กœ๋“œํ•ด์„œ ๋ฒค์น˜๋งˆํ‚น ํ•˜๋Š” ๊ณณ๋„ ์žˆ์Œ

 

๋ฐ˜์‘ํ˜•