Yes, it is a double quote.
The version I have presently is :
CHAR(34)+REPLACE(Table.Field,'"','')+CHR(34), in which I just remove the double quote so the delimiters would work. For that content, the double quote was only used to encapsulate long path+file name, which is not needed in Excel. I just wanted to include the log in there as well just to provide more information. The rest of the fields being exported are regular fields, such as Numeric and Integer.