I've broken his heart. What can I do?

I've really broken his heart and I have no idea what to do. I'll explain what happened. I had been going out with this guy for a few weeks and I really enjoyed his company. But as time went on like when he tried to kiss me and stuff I knew I didn't want it. I really loved him, but more like a brother than a boyfriend. As time went on I kept telling myself that things would get better, but I knew I was just avoiding talking to him about it. It got to the point where I would make excuses every single time that he asked to do something with me. I was in pain, and I knew I couldn't speak to him without crying. When he texted me, and put love you xxx ect. I was angry at him, I broke my phone several times by throwing it about in anger. I even started self harming because I felt alot better afterwards. I nearly started screaming down the phone because he said I love you. I knew that I would never be able to say it back to him. I punched the wall and broke my hand, because of it. On new years eve, everything got spilled out. After copious amonts of alcohol. I told my best friend everything. She decided for me that I was going to end it before I caused myself anymore pain. But still I kept avoiding it. I kept saying just one more chance. But about 10chances later I finally plucked up the courage to tell him. I let him down as easily as I could. It took me about an hour to finally get to the point, I forced myself not. To cry, but I did manage to make my hands bleed as I was clenching my fists so tightly. I couldn't even look at his face. I wouldn't. But afterwards I felt even worse. A few weeks ago, this other guy asked me out whom I am totally and irrecovbly in love with him. But I still feel guilty about my ex. I have stopped punishing myself physically but I can't stop thinking how I broke his heart. He cry over me everyday. And there isn't a time where hasn't loved me. And me getting a new boyfriend has even more destoryed him. What can I do about this? I feel so guilty,