I think it depends on some things on whether to retry when you miss a fruit or to continue playing.
One factor is when you miss. Obviously if you miss during the first 10-20 seconds, you should restart but if you miss or choke late in the map it be worth to keep playing. Since I only try to FC relatively short maps in general, I wouldn't know what decision to make when missing a fruit when FCing 2 minutes into a 4 minute song. It depends on your personal preference.
Another factor is learning the map. If you are just starting to play the map for the first time I don't think it's wise to restart since you aren't familiar with the later parts of the map. Of course, restarting during the first 10-20 seconds is justified even when playing a map you're unfamiliar with but I personally wouldn't spam retry without having a few local scores on the map first.
On the other hand, it looks like you could FC a lot of 4 star maps, including converts, already so good job at reaching the point you are now.