Downsides of a flexible benefit plan may include increased administrative burden, potential for decreased participation or understanding of benefits, and potential for increased costs for employees who choose more expensive options.