If I liked the guy, no it wouldn't be a deal breaker by any means. I once dated a guy briefly (I'll explain) who had an ileostomy. He had developed ulcerative colitis when he was 18, had multiple bowel resections over the years, and had eventually had a total colectomy. He wore a bag to collect the waste. It didn't bother me at all. I'm a surgical nurse and there isn't much about the body that I haven't seen.
He was very self conscious about it; didn't even want to take his shirt off in front of me the first time we had sex. He also didn't have a rectum...sewn shut down there, so that limited the menu. But we had some of the best sex I've ever had because he understood it's all about process.
He was a great guy and I really wanted to see where it might go, but we only dated for a month. His take was that it was all too disappointing for him; he felt like "damaged goods," and he just didn't want to deal with it. He would rather cut me off. I came to see that it didn't matter how much I was all right with everything because I wasn't the one who had to deal with it. There wasn't anything I could do.
So I would tell you, if you really like this guy and think there is some mileage possible in your relationship, don't let his physical problems stop you from going ahead with it. Decide first of all if you, yourself, are all right with his limitations and if you are, give him as much assurance as you can. Good connections don't fall out of the trees. If you find one, you're fortunate.
I wish the best for you both.