๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
728x90

๐Ÿ› Research/3D Vision3

[๋…ผ๋ฌธ ๋ฆฌ๋ทฐ] NeRF ๊ฐ„๋‹จ ์„ค๋ช… & ์›๋ฆฌ ์ดํ•ดํ•˜๊ธฐ | ์ƒˆ๋กœ์šด ๋ฐฉํ–ฅ์—์„œ ๋ฐ”๋ผ๋ณธ view๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๊ธฐ์ˆ  - paper : NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis / ECCV2020 NeRF ๋…ผ๋ฌธ์ด ๊ณต๊ฐœ๋œ์ง€๋„ ์‹œ๊ฐ„์ด ๊ฝค ํ˜๋ €๋Š”๋ฐ, 2020 ECCV์—์„œ ๊ณต๊ฐœ๋์„ ๋•Œ๋งŒ ํ•ด๋„ ๊ต‰์žฅํžˆ ์‹ ๊ธฐํ•˜๊ณ  ํš๊ธฐ์ ์ธ view synthesis ๋ฐฉ๋ฒ•์œผ๋กœ ๊ด€์‹ฌ์„ ๋ฐ›์•˜์ง€๋งŒ, ์—ฌ๋Ÿฌ ๋‹จ์  ๋•Œ๋ฌธ์— ์‹ค์ œ ์„œ๋น„์Šค์— ์ ์šฉ๋˜๊ธฐ๋Š” ์‰ฝ์ง€ ์•Š์•˜๋‹ค. ํ•˜์ง€๋งŒ, 2023 CVPR์—์„œ๋Š” 2022๋…„์— ๋น„ํ•ด radiance๋ผ๋Š” ๋‹จ์–ด์˜ ์‚ฌ์šฉ์ด 80% ์ฆ๊ฐ€ํ•˜๊ณ , NeRF์˜ ๊ฒฝ์šฐ 39% ์ฆ๊ฐ€ํ–ˆ์„ ๋งŒํผ NeRF๋Š” ํ™œ๋ฐœํžˆ ์—ฐ๊ตฌ๋˜๊ณ  ์žˆ๋‹ค. ํŠนํžˆ ์ด์   ๊ฐœ๋… ์ฆ๋ช…์„ ๋„˜์–ด veiw editing ์ด๋‚˜ ๊ฐ์ข… application ์—ฐ๊ตฌ๊ฐ€ ์ง„ํ–‰๋˜๊ณ  ์žˆ๋‹ค. ์ฆ‰ NeRF๊ฐ€ ์ด์ œ ๊ฐ์ข… ์„œ๋น„์Šค์— ํ™œ์šฉ๋ ๋งŒ.. 2023. 8. 10.
[๊ธฐ์ˆ  ์†Œ๊ฐœ] 3D Object Scanning | MVS | ๊ฐ์ฒด ์Šค์บ๋‹ | ์‹ค์‹œ๊ฐ„ 3D ๊ฐ์ฒด ๋ณต์› 3D Object Scanning 3D Object Scanning์€ multi-view stereo (MVS) ๊ธฐ์ˆ ์„ ํ™œ์šฉํ•˜์—ฌ ๊ฐ์ฒด์˜ 3D shape์„ ๋ณต์›ํ•˜๋Š” ๊ธฐ์ˆ ์ด๋‹ค. ์•„๋ž˜ ์˜์ƒ์„ ๋ณด๋ฉด Niantic์ด๋ผ๋Š” ๊ธฐ์—…์—์„œ Unity SDK์— ๋น ๋ฅธ non-lidar ์Šค์บ” ํˆด์„ ์ถ”๊ฐ€ํ•˜์—ฌ ์‚ฌ์šฉ์ž๊ฐ€ ๊ฐ์ฒด๋ฅผ ์‹ค์‹œ๊ฐ„์œผ๋กœ ์Šค์บ”ํ•  ์ˆ˜ ์žˆ๊ฒŒ ํ•œ๋‹ค. ์Šค๋งˆํŠธํฐ์œผ๋กœ ๊ฐ์ฒด๋ฅผ ๋‹ค์–‘ํ•œ ๊ฐ๋„์—์„œ ์ดฌ์˜ํ•˜๊ณ  ๊ฐ์ฒด๋ฅผ ๋ณต์›ํ•˜๋Š”๋ฐ ํ’ˆ์งˆ์ด ๊ฝค ์ข‹์•„๋ณด์ธ๋‹ค. ๋˜ํ•œ RealityScan๊ณผ ๊ฐ™์€ ์•ฑ์„ ์‚ฌ์šฉํ•˜๋ฉด ์Šค๋งˆํŠธํฐ์œผ๋กœ ๊ฐ„๋‹จํ•˜๊ฒŒ 3D ์Šค์บ”์„ ๊ฒฝํ—˜ํ•ด ๋ณผ ์ˆ˜๋„ ์žˆ๋‹ค. Niantic ๊ธฐ์—…์˜ Object Scanning ์˜ˆ์‹œ RealityScan - 3D Scanning App์˜ ๊ฒฐ๊ณผ ์˜ˆ์‹œ ์ถœ์ฒ˜ : https://sketchfab.com/3d-models.. 2023. 4. 7.
[๋…ผ๋ฌธ ๋ฆฌ๋ทฐ] MVSNet: Depth Inference for Unstructured Multi-view Stereo / ๋”ฅ๋Ÿฌ๋‹์„ ์ด์šฉํ•œ Multi-view Stereo Reconstruction ๋ฐฉ๋ฒ• ์ž„์˜์˜ N๊ฐœ์˜ view๋ฅผ ์ž…๋ ฅ์œผ๋กœ ์‚ฌ์šฉํ•˜๋Š” Multi-view Stereo Reconstuction task์—์„œ ์ „ํ†ต์ ์ธ ๋ฐฉ๋ฒ•์ด ์•„๋‹Œ, CNN ์•„ํ‚คํ…์ฒ˜๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ํ•™์Šต ๊ธฐ๋ฐ˜์˜ ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•˜๋Š” ์ฒซ ์—ฐ๊ตฌ์ด๊ธฐ์— ์†Œ๊ฐœํ•˜๋ ค ํ•ฉ๋‹ˆ๋‹ค. ์ง€๊ธˆ์€ ๋ณธ ๋…ผ๋ฌธ์—์„  ์ œ์•ˆํ•˜๋Š” MVSNet ๋ณด๋‹ค ์„ฑ๋Šฅ์ด ์ข‹์€ ๋„คํŠธ์›Œํฌ๊ฐ€ ๋งŽ์ง€๋งŒ, ๋ณธ ๋…ผ๋ฌธ์—์„œ ์ œ์•ˆํ•˜๋Š” ์•„์ด๋””์–ด๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ์—ฐ๊ตฌ๊ฐ€ ๋งŽ์Šต๋‹ˆ๋‹ค. (22๋…„ ์ดˆ ๊ธฐ์ค€ SoTA๋Š” Transformer ๊ธฐ๋ฐ˜์˜ TransMVSNet์ž…๋‹ˆ๋‹ค.) Abstract ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” multi-view(๋‹ค์‹œ์ ) ์ด๋ฏธ์ง€์—์„œ depth map inference๋ฅผ ์œ„ํ•œ end-to-end ๋”ฅ๋Ÿฌ๋‹ ์•„ํ‚คํ…์ฒ˜๋ฅผ ์†Œ๊ฐœํ•ฉ๋‹ˆ๋‹ค. ๋„คํŠธ์›Œํฌ์—์„œ ๋‹ค์‹œ์  ์ด๋ฏธ์ง€๋“ค์˜ feature๋ฅผ ์ถ”์ถœํ•œ ํ›„ ๋ฏธ๋ถ„๊ฐ€๋Šฅํ•œ homography warping.. 2022. 3. 29.
728x90