Quit working without giving a notice?

It is unlikely that they would do anything to you legally. Your reputation with them is toast whether you stay the four weeks or not. I would either look now and continue working. But you can leave today. It is doubtful that they will do anything except make empty threats. If you leave now, you can avoid putting it on your resume.