The so-called drivers' union - the Grand Prix Drivers' Association - is to hold talks with the FIA as row over swearing builds.