I had one for probably about 10 years, just a little bulge, then it got bigger. The only way to fix it is through surgery and it will only get worse, not better.
I had my surgery about a month ago, laparoscopic, and actually on both sides (I thought it was just the right side). I got it fixed because it started feeling uncomfortable and painful, like I could feel it stretching.
The surgery was simple. A hour or two. I had the mesh put in. Went home the same day. I could walk up my stairs and around my home in discomfort. Surgery is risky and I had complications (I could'nt pee afterwards so I had to get a catheter, and I was in the hospital 5 days for for a pulmonary embolism).
After surgery, I would say I felt more stiff vs in pain. It was uncomfortable, I was sore. I took pain meds probably for the first 3 or 4 days around the clock, then only as needed.
A month later, I'm okay. I have a tinge of pain every so often from where I think the mesh may be and from the incision (3 total that are healed). My balls get sore if I don't wear a jockstrap for a while (like a day).
Overall I'm glad I got it done. Some say the earlier you get it done the easier it is to repair because its smaller, the quicker your body heals. Some say wait because for most its not urgent, unless it gets strangulated, also surgery has its risks and costs alot depending on your insurance. And like you said, it loooks better.
I say get it fixed if its bothering you (physically). Otherwise, I probably would wait and see. There really is no hurry.