๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
๐Ÿ› Research/etc.

[์˜คํ”ˆ์†Œ์Šค] OpenMMLab ์ปดํ“จํ„ฐ๋น„์ „ ์˜คํ”ˆ์†Œ์Šค ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ | ๋‹ค์–‘ํ•œ ์ปดํ“จํ„ฐ๋น„์ „ ์—ฐ๊ตฌ ์ฃผ์ œ

by ๋ญ…์ฆค 2023. 4. 16.
๋ฐ˜์‘ํ˜•
OpenMMLab

 

OpenMMLab์€ ํ•™์ˆ  ์—ฐ๊ตฌ ๋ฐ ์‚ฐ์—… ์‘์šฉ์„ ์œ„ํ•œ ๋‹ค์–‘ํ•œ ์ปดํ“จํ„ฐ๋น„์ „ ์˜คํ”ˆ์†Œ์Šค ํ”„๋กœ์ ํŠธ๋“ค์„ ์ œ๊ณตํ•œ๋‹ค.  OpenMMLab์—์„œ๋Š” ์•„๋ž˜์™€ ๊ฐ™์€ ์žฅ์ ์„ ๊ฐ€์ง€๊ณ  ์žˆ๋‹ค๊ณ  ์„ค๋ช…ํ•˜๋Š”๋ฐ, ๊ต‰์žฅํžˆ ๋งŽ์€ ํ”„๋กœ์ ํŠธ์™€ ํˆด์ด ์žˆ๊ธฐ ๋•Œ๋ฌธ์— ๋‚ด๊ฐ€ ์จ๋ณธ ๊ฒƒ์€ ๊ทนํžˆ ์ผ๋ถ€์ด์ง€๋งŒ ํ•„์š”ํ•œ ๊ธฐ๋Šฅ๋“ค์„ ํŽธ๋ฆฌํ•˜๊ฒŒ ์ž˜ ๊ตฌํ˜„ํ–ˆ๋‹ค๋Š” ๋Š๋‚Œ์„ ๋ฐ›์•˜์—ˆ๋‹ค.

  • ์•Œ๊ณ ๋ฆฌ์ฆ˜ ์žฌ๊ตฌํ˜„์˜ ์–ด๋ ค์›€์„ ์ค„์ด๊ธฐ ์œ„ํ•œ ๊ณ ํ’ˆ์งˆ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ์ œ๊ณต
  • ๋‹ค์–‘ํ•œ ๋ฐฑ์—”๋“œ ๋ฐ ์žฅ์น˜๋ฅผ ๋Œ€์ƒ์œผ๋กœ ํ•˜๋Š” ํšจ์œจ์ ์ธ ๋ฐฐํฌ ๋„๊ตฌ ์ œ๊ณต
  • ์ปดํ“จํ„ฐ๋น„์ „ ์—ฐ๊ตฌ ๋ฐ ๊ฐœ๋ฐœ์„ ์œ„ํ•œ ๊ฒฌ๊ณ ํ•œ ๊ธฐ๋ฐ˜ ๊ตฌ์ถ•
  • ํ’€์Šคํƒ ํˆด์ฒด์ธ์œผ๋กœ ํ•™์ˆ  ์—ฐ๊ตฌ์™€ ์‚ฐ์—… ์‘์šฉ ํ”„๋กœ๊ทธ๋žจ ๊ฐ„์˜ ๊ฒฉ์ฐจ ํ•ด์†Œ

๊ฐœ์ธ์ ์œผ๋กœ๋Š” Pytorch ๊ธฐ๋ฐ˜์ด๋ผ ์ข‹์•˜๋‹ค...

 

MMDetection, MMSegmentation

OpenMMLab์€ ๊ต‰์žฅํžˆ ๋‹ค์–‘ํ•œ ์ปดํ“จํ„ฐ๋น„์ „ ์—ฐ๊ตฌ ์ฃผ์ œ์—์„œ ์ตœ์‹  ๋”ฅ๋Ÿฌ๋‹ ๋ชจ๋ธ๊ณผ ๊ณ ์„ฑ๋Šฅ ์ฝ”๋“œ๋ฅผ ์ œ๊ณตํ•˜๊ธฐ ๋•Œ๋ฌธ์— ์ปดํ“จํ„ฐ๋น„์ „ ๊ด€๋ จ ๊ฐœ๋ฐœ์„ ํ•œ๋‹ค๋ฉด ํ•œ ๋ฒˆ์ฏค์€์„ ์ ‘ํ•ด๋ดค์„ ๊ฒƒ์ด๋‹ค. ํŠนํžˆ MMDetection๊ณผ MMSegmentation์€ ์›Œ๋‚™ ์œ ๋ช…ํ•˜๋‹ˆ ๋‹ค๋“ค ์ด๋ฆ„์€ ๋“ค์–ด๋ดค์„ ๊ฒƒ์ด๋‹ค.

 

MMDetection์˜ ๊ฒฝ์šฐ Fast RCNN๋ถ€ํ„ฐ 22๋…„์— ๊ณต๊ฐœ๋œ ๋ชจ๋ธ์— ์ด๋ฅด๊ธฐ๊นŒ์ง€ ์ •๋ง ๋‹ค์–‘ํ•œ ๋ชจ๋ธ์„ ์ œ๊ณตํ•˜๊ณ , MMSegmentation์˜ ๊ฒฝ์šฐ์—๋„ FCN๋ถ€ํ„ฐ 22๋…„์— ๊ณต๊ฐœ๋œ Mask2Former ๋ชจ๋ธ๊นŒ์ง€ ์ œ๊ณตํ•œ๋‹ค. 

 

 

OpenMMLab์˜ ๋‹ค์–‘ํ•œ ์ปดํ“จํ„ฐ๋น„์ „ ํ”„๋กœ์ ํŠธ

๊ทธ๋Ÿฐ๋ฐ ์•Œ๊ณ ๋ณด๋‹ˆ detction, segmentation ์ด์™ธ์—๋„ ์œ„์™€ ๊ฐ™์€ ๊ต‰์žฅํžˆ ๋‹ค์–‘ํ•œ ์ฃผ์ œ์˜ ํ”„๋กœ์ ํŠธ๋ฅผ ์ง„ํ–‰ํ•˜์—ฌ ๊ด€๋ จ ์˜คํ”ˆ์†Œ์Šค ํˆด๋ฐ•์Šค๋ฅผ ์ œ๊ณตํ•œ๋‹ค. 3D detection, OCR, generative model, optical flow ๋“ฑ์˜ ์ปดํ“จํ„ฐ๋น„์ „ ํ”„๋กœ์ ํŠธ, self/un-supervised learning, few-shot learning ๋“ฑ์˜ ํ•™์Šต ๋ฐฉ๋ฒ•๋ก ์— ๋Œ€ํ•œ ํ”„๋กœ์ ํŠธ, ์‹ฌ์ง€์–ด model deployment, compression ๋“ฑ๊ณผ ๊ฐ™์€ ์ฃผ์ œ๊นŒ์ง€ ๋‹ค๋ฃจ๊ธฐ์— ๊ด€๋ จ ์—ฐ๊ตฌ๋‚˜ ๊ฐœ๋ฐœ์„ ์ง„ํ–‰ํ•˜๊ณ  ์žˆ๋‹ค๋ฉด ์ฐธ๊ณ ํ•ด๋ณผ๋งŒ ํ•˜๋‹ค.

 

*OpenMMLab ํ”„๋กœ์ ํŠธ
Object detection, segmentation, 3D detection, Object tracking, OCR, pose estimation, action understanding, 3D human parametric model, generative model, optical flow, LiDAR-based 3D scene perception, visual fashion analysis, self/un-supervised learning, few-shot learning, model deployment, model compression

 

OpenMMLab ํ”„๋กœ์ ํŠธ ์˜์ƒ

 

Optical Flow

 

 

Rotating Object Detection

 

 

Pose Estimation

 

 

Object Tracking 

 

 

Generation task

Training Visualization, GAN Interpolation, GAN Manipulation

 

 

๋ฐ˜์‘ํ˜•