Using version 8.0.6 I also find the inlay duration to be permanent and duration to not have an effect. However, with version 7.2.2 the duration works as expected.
How did you manage to only have 1 line in the inlay?
That would be a desired feature for me (data only without time).