Banker built small building society into lending powerhouse before collapse during financial crisis