Toward parallel scalable linear solvers suited for large scale hierarchical parallel platforms