Fixed the energy on the pure lambertian surface. Since I chose to go with no Fresnel for such surfaces the walls, the energy has to completely go to lambertian.

I think I got the fresnel for reflection sphere.

Make the fresnel actually glossy for the refraction ball.

I have no idea how to do fresnel on the glossy reflection ball. 1024spp, NEE only.

Best I could do without Fresnel. Trying to add fresnel from now on. The acnes Im supposing NaN, will look into that later

First image Im getting after I implement the whole thing based on my current understanding. I can tell problems about Fresnel and refraction not working, still WIP. But I think it might be a good start since the energy looks pretty correct.