The single-shear tensile tests on carbon fiber reinforced plastic (CFRP) laminates and aluminum alloy(AlMg3) dissimilar materials with different textile structures were carried out to study the impact of clearance on the joining between CFRP laminates and AlMg3. The test results show that the CFRP-AlMg3 single-shear connection structure with the same clearance and dissimilar textile structure when the layers of CFRP laminates are given, the compressive stress of the woven fabric CFRP(WO-CFRP) laminates is about 25% higher than that of the unidirectional CFRP(UD-CFRP) laminates. Little difference occurs between the shear stress of their rivets and that of the CFRP laminate for CFRP-AlMg3 single-shear joining structures with the same textile structure and different clearance. At the same time, the extrusion stress analysis of CFRP-AlMg3 single-shear joining structure of the same clearance and different textile structure was also studied. The extrusion stress of WO-CFRP in each stage is higher than that of UD-CFRP high stress about 20% when the other conditions are given. Finally, the effect of clearance on the single-shear joining structure of CFRP-AlMg3 single rivet was studied. The results show that the CFRP laminate has a greater influence on the shear stress when the clearance is 4% of the rivet diameter. When the clearance between the rivet and the hole wall is increased by 0.1 mm and the displacement is 4% of the diameter of the rivet, the compressive stress on the CFRP laminate is reduced by about 17%, whereas the initial damage stress and failure stress on the CFRP laminate are almost none affect and the shear stress on the rivets and the extrusion stress on the aluminum alloy has almost no effect.