๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
728x90

๐Ÿ“– Theory/3D vision & Graphics3

[CV] SFM (Structure From Motion) : ์—ฐ์†๋œ 2D ์ด๋ฏธ์ง€๋“ค๋กœ ์นด๋ฉ”๋ผ ํฌ์ฆˆ์™€ 3D shape ์žฌ๊ตฌ์„ฑํ•˜๊ธฐ ๋ณธ ํฌ์ŠคํŒ…์—์„œ๋Š” visual localization์— ํ•„์ˆ˜์ ์ธ 2D ์˜์ƒ์œผ๋กœ 3D ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๋Š” SFM (Structure From Motion) ์— ๋Œ€ํ•ด ์ตœ๋Œ€ํ•œ ์ˆ˜์‹์—†์ด ๊ฐ ๋‹จ๊ณ„์˜ ๋ชฉ์ ๊ณผ ์˜๋ฏธ์— ์ง‘์ค‘ํ•˜์—ฌ ์†Œ๊ฐœํ•˜๋ ค ํ•œ๋‹ค SFM์€ GUI๊ฐ€ ์žˆ๋Š” ๋ฒ”์šฉ SFM (Structure From Motion), MVS (Multi View Stereo) ํŒŒ์ดํ”„๋ผ์ธ์ธ COLMAP ๋“ฑ์˜ visual localization task ์—์„œ ์‚ฌ์šฉ๋œ๋‹ค. COLMAP์˜ ๊ฒฝ์šฐ ์ •๋ ฌ๋œ ๋˜๋Š” ์ •๋ ฌ๋˜์ง€ ์•Š์€ ์ด๋ฏธ์ง€์˜ reconstruction ๊ธฐ๋Šฅ์„ ์ œ๊ณตํ•œ๋‹ค.(Multi-view ์ด๋ฏธ์ง€๋“ค๋งŒ ๋„ฃ์œผ๋ฉด camera pose + 3D shape์„ ๋ณต์›ํ•ด์ค๋‹ˆ๋‹ค.) * SFM๊ณผ ์œ ์‚ฌํ•œ ์•Œ๊ณ ๋ฆฌ์ฆ˜? SFM๊ณผ ์œ ์‚ฌํ•œ ์•Œ๊ณ ๋ฆฌ์ฆ˜์œผ๋กœ ๋งŽ์ด ์•Œ๋ ค์ ธ ์žˆ๋Š” S.. 2022. 6. 5.
[CV] 3D Geometry ์„ค๋ช… *์ž๋ฃŒ ์ถœ์ฒ˜ : ๋‹คํฌํ”„๋กœ๊ทธ๋ž˜๋จธ https://darkpgmr.tistory.com/category/%EC%98%81%EC%83%81%EC%B2%98%EB%A6%AC Coordinate System (์ขŒํ‘œ๊ณ„) ์˜์ƒ geometry ์—์„œ๋Š” ์›”๋“œ(3D), ์นด๋ฉ”๋ผ(3D), ์ •๊ทœ(2D), ํ”ฝ์…€(2D) 4๊ฐœ์˜ ์ขŒํ‘œ๊ณ„๊ฐ€ ์กด์žฌํ•ฉ๋‹ˆ๋‹ค. - ์›”๋“œ ์ขŒํ‘œ๊ณ„ ๊ฐ์ฒด์˜ ์œ„์น˜๋ฅผ ํ‘œํ˜„ํ•  ๋•Œ ๊ธฐ์ค€์œผ๋กœ ์‚ผ๋Š” ์ขŒํ‘œ๊ณ„๋กœ ์นด๋ฉ”๋ผ ์ขŒํ‘œ๊ณ„์™€ ๋‹จ์œ„๋ฅผ ๋งž์ถฐ์•ผ ํ•˜๊ณ  ์œ„(P)์™€ ๊ฐ™์ด ํ‘œํ˜„ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. - ์นด๋ฉ”๋ผ ์ขŒํ‘œ๊ณ„ ์นด๋ฉ”๋ผ๋ฅผ ๊ธฐ์ค€์œผ๋กœ ํ•œ ์ขŒํ‘œ๊ณ„์ด๋ฉฐ, ์•„๋ž˜์ฒจ์ž c ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์œ„์™€ ๊ฐ™์ด ํ‘œํ˜„ํ•ฉ๋‹ˆ๋‹ค. - ํ”ฝ์…€ ์ขŒํ‘œ๊ณ„ ์˜์ƒ ์ขŒํ‘œ๊ณ„๋ผ๊ณ ๋„ ๋ถˆ๋ฆฌ๋ฉฐ ์ด๋ฏธ์ง€์˜ ์™ผ์ชฝ ์œ„๋ฅผ ์›์ ์œผ๋กœ ์˜ค๋ฅธ์ชฝ ๋ฐฉํ–ฅ์„ x ์ฆ๊ฐ€ ๋ฐฉํ–ฅ, ์•„๋ž˜ ๋ฐฉํ–ฅ์„ y ์ฆ๊ฐ€ ๋ฐฉํ–ฅ์œผ๋กœ ํ•ฉ๋‹ˆ๋‹ค. ํ”ฝ์…€ ์ขŒํ‘œ๊ณ„์˜.. 2022. 4. 4.
[Graphics] 3D model์˜ material ์†์„ฑ / obj, mtl ํŒŒ์ผ PBR Texture 3D ๋ชจ๋ธ๋ง ๋ถ„์•ผ์—์„œ ์žฌ์งˆ ํ‘œ๋ฉด์˜ ์†์„ฑ์— ๋”ฐ๋ผ ๋ฐ˜์‚ฌ, ๊ตด์ ˆ, ํˆฌ๊ณผ ๋“ฑ์˜ ์†์„ฑ์ด ๋ฌผ๋ฆฌ์ ์œผ๋กœ ์ž‘์šฉํ•˜๊ณ  ์‹œ๊ฐ์ ์œผ๋กœ ํ‘œํ˜„ํ•˜๋Š” ๊ธฐ๋ฒ•์„ Physical Base Rendering (PBR) ์ด๋ผ๊ณ  ํ•œ๋‹ค. ์žฌ์งˆ ์†์„ฑ์€ Roughness, Metalness ๋“ฑ ๋‹ค์–‘ํ•˜๊ฒŒ ์กด์žฌํ•˜๊ณ  ์ด๋“ค์„ ๋‹ค์–‘ํ•œ map์œผ๋กœ ํ‘œํ˜„ํ•  ์ˆ˜ ์žˆ๋Š”๋ฐ, ์ด๋Ÿฌํ•œ ์žฌ์งˆ ํ‘œํ˜„์„ ์œ„ํ•ด texture ํŒŒ์ผ์„ ๋ชจ์•„๋†“์€ ๊ฒƒ์„ PBR texture๋ผ๊ณ  ํ•œ๋‹ค. ์ œ์ž‘ํ•œ ๊ณณ์— ๋”ฐ๋ผ ์กฐ๊ธˆ์”ฉ ์ด๋ฆ„์ด ๋‹ค๋ฅผ ์ˆ˜ ์žˆ์ง€๋งŒ ์ผ๋ฐ˜์ ์œผ๋กœ ์•„๋ž˜์™€ ๊ฐ™์€ ์ข…๋ฅ˜๋“ค์ด ์žˆ๋‹ค. Albedo (๋˜๋Š” Diffuse, Base color) Normal, Bump, Displacement, Height Rughness (๋˜๋Š” Glossiness) Metalness Specular (.. 2022. 4. 4.
728x90