You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I see how the DotnetRunner is able to send output to the logs of the spark driver.
But I'm assuming that is happening from the java module not from the .Net core side of things. I can't find any interface on the .net side to actually send messages into the logs (although you can adjust the verbosity with things like spark.SparkContext.SetLogLevel).
I'd love to send custom output into the same log so that it is easier to find, and is correlated with all the other output. So far I've only been sending my output to standard output or standard error.
Is there any way for the .Net driver to send data into the log4j logging output? Does this seem feasible/useful? Any help would be appreciated?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I see how the DotnetRunner is able to send output to the logs of the spark driver.
But I'm assuming that is happening from the java module not from the .Net core side of things. I can't find any interface on the .net side to actually send messages into the logs (although you can adjust the verbosity with things like spark.SparkContext.SetLogLevel).
I'd love to send custom output into the same log so that it is easier to find, and is correlated with all the other output. So far I've only been sending my output to standard output or standard error.
Is there any way for the .Net driver to send data into the log4j logging output? Does this seem feasible/useful? Any help would be appreciated?
Beta Was this translation helpful? Give feedback.
All reactions