He said if he were to ever get married it would be with me. What does this mean really?

We're both young, 24 and 23, met and fell in love our last year in college and have been dating ever since like for a year. We sleep together a lot, we don't live together but we have discussed moving in together. Neither of us are financially stable enough to move in together at the moment. But I feel like we need a plan, he is so fickle, one moment he's all about moving in together and marriage and having babies and then the next moment he's like "I don't know if I can ever get married but if I did it would be with you." Does this sound like bs to you? I feel dirty sleeping with him knowing that out future is unsecured. We are in an exclusive relationship but lately I just feel like I am swimming in a sea of anticipation, I have a hard time reading him. I know for sure he means it when he says he loves me. He says he needs to get his life together, a good job and then maybe we can move in together, but whats with the maybe? He said he doesn't feel like a man. I just don't get it. I don't want him to promise me marriage, I just want him to commit more so than now. He only comes to see me once a week, he lives over 70 miles away, he says he's doing the best he can right now, balancing school and work and me. But I feel unfulfilled, I told him this and he suggested that we stop seeing each other. I told him I didn't want that, that I just wanted more from him, is it really that impossible? Am I asking for too much? And then whenI brought up moving in together again, he said he wasn't sure because he wanted to be close to his job, I told him we could compromise and move somewhere in between where we both work and he agreed but by this time he was kind of falling asleep. So I don't know what to do, I love him with all my heart and I want nothing more than to make things work between us. He suggested that we just slow down, maybe he's right, but what does he mean by that?