Comb model : Non-markovian versus markovian