There's also a media selection drop-down up top that allows you to jump from music to movies, TV shows, podcasts and more. That change doesn't really simplify things, it just hides the category icons that used to be always visible in menu that displays one at a time. It does tell you exactly what items you're looking at with a glance.
One issue that hasn't been fixed is where to find Apple Music. There's no menu item specifically labeled for the service, but instead its pieces are separated in tabs For You, New and Connect in iTunes. While reports indicate that Apple Music's app is in for a major redesign at WWDC, we'll have to wait and see if that includes how you use the service on the desktop. We'd surmise that Connect tab won't be around much longer, though, as the social features don't appear to be very popular.
Today's update to version 12.4 also mentions the usual generic bug fixes and performance improvements, but doesn't specifically list the file-deleting bug users have discovered in iTunes. Apple confirmed the issue late last week and said that it was working on a patch to fix the issue. We've reached out to the company for confirmation on whether on not the problem has been resolved and we'll update this post when/if we hear back.