Learn the work behind Data, AI & Forward Deployed Engineering
Practical explanations, career decisions and reproducible workflows. Read the reasoning, inspect the evidence and follow the next skill into a real programme.
Pandas groupby with missing categories and explicit denominators
Use groupby(dropna=False) when missing grouping values must remain visible, and specify what each denominator counts. size counts rows; count counts nonmissing values in a selected column. Those quantities differ wheneve
Pandas merge_asof for time-aligned event data
Use mergeasof when an event needs the closest eligible state in time rather than an exact timestamp match. For the latest state already available at an event, choose backward matching, group by entity and set a maximum a
Pandas merge validation: catch many-to-many joins early
Declare the expected join cardinality with merge(validate=...) before trusting an enriched dataframe. For many orders joined to one customer record, use manytoone. Then check unmatched keys and reconcile the output grain
Pandas resample: make absent days visible
Resample onto an explicit calendar, then use source-coverage evidence to decide whether an empty day means zero or unknown. A missing row in an extract is not proof that no business activity occurred.
Pandas string cleaning with reversible mappings
Keep the original text and write cleaned values to separate columns. Many cleaning operations are many-to-one: trimming spaces or changing case can make different source strings identical. You cannot reliably reconstruct
Parameterize Python SQL queries without string interpolation
Pass data values separately from SQL text through the database driver's parameter interface. This lets the driver treat a customer name or date as a value, even if its text contains quotes or resembles SQL syntax. Buildi
Parameterize reports by date and region safely
Report parameters should make a calculation reusable without making its meaning ambiguous. Validate dates, timezones, allowed regions and required fields before reading data. Record the selected parameters with the outpu
Parquet versus CSV: measure size and read behaviour
CSV is plain text and broadly interoperable. Parquet is columnar, typed and compressed, allowing engines to read selected columns and skip row groups. The practical difference depends on data, compression, filesystem, ca
Partial dependence: recognize correlated-feature limitations
Partial dependence asks a fitted model to vary one feature across a grid while averaging predictions over the observed values of the other features. That can summarize model behaviour. When features are strongly dependen
Partial derivatives: understand a model's local sensitivity
A partial derivative describes how a function changes locally when one input changes while the others are held fixed. The gradient collects those derivatives into a vector. It can help explain a model's local numerical s
Partition a dataset around common access patterns
Partitioning places rows into directory or storage units so queries can skip irrelevant data. A useful partition key appears in common filters and has manageable cardinality. Partitioning by a nearly unique account can c
PCA for compression without leaking test information
PCA does not use the target, but it learns means and directions from data. Fitting scaling or PCA on test rows lets their distribution shape the representation before evaluation. Unsupervised preprocessing can still leak
Not sure which programme fits?
Tell us your background and we will map it to the right entry point — including saying so when a cheaper programme is the better fit. A counsellor replies within one working day.