The bar above shows two important things about response time.
Any moderately complex task involves both long term and short term memory. In a famous 1956 paper George Miller advanced the hypothesis that the capacity of human short term memory is seven chunks of information (plus or minus two). Thus solutions to problems that require the someone to remember more than seven pieces of information are likely to be more difficult to implement since some of the information must be stored in long term memory, which for most of us means writing it down.
(I am reminded of a description of the English University system that a contemporary of mine who was at Oxford gave me. He called it "the sponge theory of learning". You cram your head with everything about a certain topic and in the exam squeeze all the knowledge out leaving the examination room having forgotten everything you knew about the topic. Ironically it probably is very good training if you are going to be a trial lawyer or a cabinet minister.)
The challenge then is for the system to have the long term memory and present the short term needs "just in time" so that the user does not need to maintain information in long term memory. Long delays in system response can cause the user to forget her plan with a subsequent further slowdown. On the other hand if the user works too fast she is more prone to errors brought on by excessive haste. There is some balance between speed and accuracy that needs to be maintained.
Based upon the research in the field Schneiderman draws the following conclusions.
It should be noted that much of this is task dependent and that users can adapt to significant variations if they have to.