Diffusion magnetic resonance imaging (dMRI) appears currently as the unique imaging modality to investigate noninvasively both ex vivo and in vivo three-dimensional fiber architectures of the human heart. However, it is difficult to know how well the diffusion characteristics calculated from diffusion images reflect the microstructure properties of the myocardium since there is no ground-truth information available and add to that the influence of various factors such as spatial resolution, noise and artifacts, etc. The main objective of this thesis is then to develop realistic model-based dMRI simulators to simulate diffusion-weighted images for both ex vivo and in vivo cardiac fibers by integrating different imaging modalities, and propose a generic tool for the evaluation of imaging quality and image processing algorithms. To achieve this, the present work focuses on four parts. The first part concerns the formulation of basic dMRI simulation theory for diffusion image generation and subsequent applications on simple cardiac fiber models, and tries to elucidate the underlying relationship between the measured diffusion anisotropic properties and the cardiac fiber characteristics, including both physical and structural ones. The second part addresses the simulation of diffusion magnetic resonance images at multiple scales based on the polarized light imaging data of the human heart. Through both qualitative and quantitative comparison between diffusion properties at different simulation scales, the relationship between the microstructure variation and the diffusion properties observed at macroscopic scales is investigated. The third part deals with studying the influence of imaging parameters on diffusion image properties by means of the improved simulation theory. The last part puts the emphasis on the modeling of in vivo cardiac fiber structures and the simulation of the corresponding diffusion images by combining the cardiac fiber structure and the a priori known heart motion. The proposed simulators provide us a generic tool for generating the simulated diffusion images that can be used for evaluating image processing algorithms, optimizing the choice of MRI parameters in both ex vivo and in vivo cardiac fiber imaging, and investigating the relationship between microscopic fiber structure and macroscopic diffusion properties.