๐Ÿ˜Ž ๊ณต๋ถ€ํ•˜๋Š” ์ง•์ง•์•ŒํŒŒ์นด๋Š” ์ฒ˜์Œ์ด์ง€?

[DEEPNOID ์›ํฌ์ธํŠธ๋ ˆ์Šจ]_10_GAN ๋ณธ๋ฌธ

๐Ÿ‘ฉ‍๐Ÿ’ป ์ธ๊ณต์ง€๋Šฅ (ML & DL)/ML & DL

[DEEPNOID ์›ํฌ์ธํŠธ๋ ˆ์Šจ]_10_GAN

์ง•์ง•์•ŒํŒŒ์นด 2022. 1. 28. 15:16
728x90
๋ฐ˜์‘ํ˜•

220128 ์ž‘์„ฑ

<๋ณธ ๋ธ”๋กœ๊ทธ๋Š” DEEPNOID ์›ํฌ์ธํŠธ๋ ˆ์Šจ์„ ์ฐธ๊ณ ํ•ด์„œ ๊ณต๋ถ€ํ•˜๋ฉฐ ์ž‘์„ฑํ•˜์˜€์Šต๋‹ˆ๋‹ค>

https://www.deepnoid.com/

 

์ธ๊ณต์ง€๋Šฅ | Deepnoid

DEEPNOID๋Š” ์ธ๊ณต์ง€๋Šฅ์„ ํ†ตํ•œ ์ธ๋ฅ˜์˜ ๊ฑด๊ฐ•๊ณผ ์‚ถ์˜ ์งˆ ํ–ฅ์ƒ์„ ๊ธฐ์—…์ด๋…์œผ๋กœ ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ๋”ฅ๋…ธ์ด๋“œ๊ฐ€ ๊ฟˆ๊พธ๋Š” ์„ธ์ƒ์€, ์˜๋ฃŒ ์ธ๊ณต์ง€๋Šฅ์ด ์ง€๊ธˆ๋ณด๋‹ค ํ›จ์”ฌ ๋„“์€ ๋ฒ”์œ„์˜ ์งˆํ™˜์˜ ์—ฐ๊ตฌ, ์ง„๋‹จ, ์น˜๋ฃŒ์— ๋„์›€

www.deepnoid.com

 

 

 

 

 

1. Deep Convolutional GAN

: ๋„คํŠธ์›Œํฌ ๊ตฌ์กฐ๊ฐ€ fully-connected ๋˜์–ด ์žˆ์ง€ ์•Š๊ณ , convolution & de-convolution ํ™œ์šฉํ•˜์—ฌ ๋ ˆ์ด์–ด ๊ตฌ์„ฑ

: ์ƒ๋Œ€์ ์œผ๋กœ ์•ˆ์ •์ ์ธ ํ•™์Šต

: convolution ์˜ ๋ฐ˜๋Œ€๊ณผ์ •์œผ๋กœ, activation map ์˜ ํฌ๊ธฐ๋ฅผ ํ‚ค์šธ ์ˆ˜ ์žˆ์–ด์„œ ์ด๋ฏธ์ง€ ์ƒ์„ฑ์— ํŠนํ™”

 

2. Progressive GAN

: ํ•™์Šต ์•ˆ์ •์„ฑ

: 1024 x 1024 size ์˜ ๊ณ ํ•ด์ƒ๋„ ์ด๋ฏธ์ง€ ์ƒ์„ฑ ๊ฐ€๋Šฅ

: low-resolution ๋ถ€ํ„ฐ ํ•™์Šต

: ์ƒˆ๋กœ์šด layer ์ถ”๊ฐ€ํ•˜์—ฌ high-resolution ์˜์ƒ ํ•™์Šต

 

3. Wassersetein GAN

: discriminator ์˜ loss function ์„ wasserstein loss ๋กœ ์‚ฌ์šฉ

: discriminator์˜ weight clipping (gradient clipping)

: RMSProp๋ฅผ optimizer ๋กœ ์‚ฌ์šฉ

: critic ( discriminator )์€ input image ์— ๋Œ€ํ•œ ์ ์ˆ˜๋ฅผ ์‚ฐ์ถœ

 

- weight cliping 

: exploding gradient or vanishing gradient ๋ฌธ์ œ ์ค„์ด๊ธฐ

: critic ์„ ๊ตฌ์„ฑํ•˜๋Š” layer์— ์ ์šฉํ•˜๋ฉฐ, update ๋˜๋Š” weight ๊ฐ’์„ ์„ค์ •ํ•œ ์ž„๊ณ„๊ฐ’์„ ใ…—์ œํ•œ

 

 

4. Least squares loss function

: generator ๋กœ๋ถ€ํ„ฐ ์ƒ์„ฑ๋œ data ๊ฐ€ decision boundary ๋กœ๋ถ€ํ„ฐ ๋ฉ€๊ฒŒ ์ƒ์„ฑ๋œ fake sample ๋“ค์— penalty ๋ถ€๊ณผ

: discriminator ์„ ์†์ธ data ์ผ์ง€๋ผ๋„ penalty ํ†ตํ•ด dicision boundary ์— ๊ฐ€๊น๊ฒŒ ์ƒ์„ฑ๋˜๊ฒŒ๋” generator ์˜ wiehgt ๋ฅผ update ์‹œํ‚ด

 

 

728x90
๋ฐ˜์‘ํ˜•
Comments