What worried him most was their not going there.

• 最使他担心的是，他们没有上那儿去。