Gilded Rails did something like this, and people thought that the flavour text wasn’t clear enough and it wasn’t obvious that it was actually a difficulty setting. So I’d say if you’re doing something like this make sure that it’s unequivocal that a particular choice affects the difficulty.
It does sound silly when you put it like that 
, but in general I think “you can’t be good at everything” is both a sound game design principle, and true to life.