PNGs come as they are. You can paste or place in any program. You can’t really change the color or shape, and if you try to make them a lot bigger, they will get pixelated.
SVGs are vectors, meaning they’re completely customizable. Make them as big or as small as you want, change the colors, or even change the shapes themselves.