build: Add spark-4.1 profile and shims#2829

manuzhang wants to merge 8 commits intoapache:mainapache/datafusion-comet:mainfrom

manuzhang:spark-4.1manuzhang/datafusion-comet:spark-4.1Copy head branch name to clipboard