Next, I port forward into my pod running jupyter via kubectl port-forward spark-test 8888:8888 and setup my spark session via the following: import sys, os, re, pprint, subprocess from pyspark.conf ...
The hudi table is partitioned by day and has around 95 partitions. Each partition is between 5 GB to 15 GB and total size is around 930 GB. When I fire a query (count ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results