Professional Documents
Culture Documents
LAMMPS Presentation Kloss
LAMMPS Presentation Kloss
I. Introduction
Industrial perspective of macroscopic particle processes, CFDEMproject
II. Modelling Approaches
CFD-DEM (resolved and unresolved), coarse-graining, MP-PIC
III. Scalability, Efficiency and Maintainability
Parallelization (distributed and shared mem), benchmarks, code design
IV. Applications
Iron/steelmaking, bulk solids handling, environmental eng., fluidized beds,
minerals processing, agricultural
V. Conclusions
VI. Acknowledgements
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 2
I.
Introduction
LIGGGHTS+CFDEMcoupling
The Importance of Bulk Solids
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 4
LIGGGHTS+CFDEMcoupling
The Importance of Bulk Solids
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 5
LIGGGHTS+CFDEMcoupling
The Framework
Professional Base: Scientific Base:
CFDEMproject is not approved or endorsed by OpenCFD Limited, the producer of the OpenFOAM® software and owner of the OpenFOAM®
and OpenCFD® trade marks. OpenFOAM® is a registered trade mark of OpenCFD Limited, a wholly owned subsidiary of the ESI Group.
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 6
LIGGGHTS+CFDEMcoupling
CFDEM Community after 3 yrs
Shown below are number of post in forums (left) and regional distribution of visitors.
5000
CFDEMproject
# post in forum*
4000
LAMMPS
3000
2000
1000
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 7
III.
Modelling Approaches
LIGGGHTS+CFDEMcoupling
CFD-DEM
Fluid-particle interaction
• unresolved CFD-DEM
• resolved CFD-DEM
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 9
LIGGGHTS+CFDEMcoupling
Unresolved CFD-DEM
1) Goniva, C., Kloss, C., Deen, N.G., Kuipers, J.A.M. and Pirker, S. (2012): “Influence of Rolling Friction
Modelling on Single Spout Fluidized Bed Simulations”, Particuology, DOI 10.1016/j.partic.2012.05.002
2) Z.Y. Zhou, S.B. Kuang, K.W. Chu and A.B. Yu (2010) : “Discrete particle simulation of particle-fluid flow:
Model formulations and their applicability”, Journal of Fluid Mechanics 661, 482-510.
3) Radl S., Radeke, Ch., Khinast, J., Sundaresan, S. (2011) : ”Parcel-Based Approach for the Simulation of
Gas-Particle Flows” , Proc. CFD 2011 Conference, Trondheim, Norway
4) Fluent® Manual
5) Andrews, M.J., O’Rourke, P.J. (1996): “The multi-phase particle-n-cell (MP-PIC) method for dense
particle flow”, Int. J. Multiphase Flow, 22, 379-402
6) Benyahia, S., Sundaresan, S. (2012): “Do we need sub-grid corrections for both continuum and discrete
gas-particle flow models”, Powder Technology, 220, 2-6
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 10
LIGGGHTS+CFDEMcoupling
Unresolved CFD-DEM
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 11
LIGGGHTS+CFDEMcoupling
Unresolved CFD-DEM
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 12
LIGGGHTS+CFDEMcoupling
Unresolved CFD-DEM
Fine grid Coarse grid
Small structures
are lost
• Functions f and h are fitted to CFD-DEM data (not shown). The parcel size correction (i.e.,
the parameter k in the expression below) is based on a comparison for the sedimentation
velocity:
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com
LIGGGHTS+CFDEMcoupling
Unresolved CFD-DEM
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 14
LIGGGHTS+CFDEMcoupling
Unresolved CFD-DEM
xp
2 Characteristics:
g u u p
1
p F int eraction
•
p p p
f Fluid equations similar to CFD-DEM
t
2
1) Basic form of equations following: Benyahia, S., Sundaresan, S. (2012): “Do we need sub-grid corrections
for both continuum and discrete gas-particle flow models”, Powder Technology, 220, 2-6
Also needs corrections for coarse-graining / coarse-grid simulations!
Coarse-Grained CFD-DEM
Both need corrections (filtered drag laws) for using coarser grids
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 16
LIGGGHTS+CFDEMcoupling
Resolved CFD-DEM
Incompressible (1)
Navier-Stokes
equations (+BC)
conservation of (2)
• mass and
• momentum (3)
Ω
Γ
ΩS
ΓS
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 17
LIGGGHTS+CFDEMcoupling
Resolved CFD-DEM
Ω stairstep
Γ vs.
ΩS smooth
ΓS
Scalability, Efficiency
and Maintainability
LIGGGHTS+CFDEMcoupling
Some wise words...
Solution:
• Efficiency and Parallel Scalability – harnessing availabe CPU ressources
• Parcel approach – particle coarse graining of 10 reduces sim. time by 1000
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 21
LIGGGHTS+CFDEMcoupling
LIGGGHTS MPI Parallelization
Initial Configuration
max. # particles per process = 11
Thanks to:
Process 1
Process 0
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 22
LIGGGHTS+CFDEMcoupling
LIGGGHTS MPI Loadbalancing
Thanks to:
Process 1
Process 0
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 23
LIGGGHTS+CFDEMcoupling
LIGGGHTS MPI Loadbalancing
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 24
LIGGGHTS+CFDEMcoupling
LIGGGHTS Parallelization
Process 0
Process2
vibratory oscillation of
Speed-Up
sample mesh
Process 1
Process3
blue: LIGGGHTS 1.5.3,
Speed-Up
4,00
3,00
2,00
1,00
0,00
1 2 4 8
Process 0 Process 1
Number of processors
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 25
LIGGGHTS+CFDEMcoupling
LIGGGHTS & Shared Memory
Need to make LIGGGHTS fit for hybrid shared-distributed cluster
architecture (left: MPI parallelization, right: shared memory parallelization)
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 26
LIGGGHTS+CFDEMcoupling
CFDEMcoupling Scalability
Process 2 Process 3
CFDEMcoupling LIGGGHTS CFDEMcoupling LIGGGHTS
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 27
LIGGGHTS+CFDEMcoupling
CFDEMcoupling Scalability
Process 2 Process 3
CFDEMcoupling LIGGGHTS CFDEMcoupling LIGGGHTS
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 28
LIGGGHTS+CFDEMcoupling
CFDEMcoupling Scalability
Process 2 Process 3
CFDEMcoupling LIGGGHTS CFDEMcoupling LIGGGHTS
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 29
LIGGGHTS+CFDEMcoupling
CFDEMcoupling Scalability
Process 0 Process 1
CFDEMcoupling LIGGGHTS CFDEMcoupling LIGGGHTS
Process 2 Process 3
CFDEMcoupling LIGGGHTS CFDEMcoupling LIGGGHTS
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 30
LIGGGHTS+CFDEMcoupling
CFDEMcoupling Scalability
Process 0 Process 1
CFDEMcoupling LIGGGHTS CFDEMcoupling LIGGGHTS
Process 2 Process 3
CFDEMcoupling LIGGGHTS CFDEMcoupling LIGGGHTS
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 31
LIGGGHTS+CFDEMcoupling
CFDEMcoupling Scalability
Process 0 Process 1
CFDEMcoupling LIGGGHTS CFDEMcoupling LIGGGHTS
Process 2 Process 3
CFDEMcoupling LIGGGHTS CFDEMcoupling LIGGGHTS
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 32
LIGGGHTS+CFDEMcoupling
CFDEMcoupling Scalability
Fluidized Bed Scaled-Size Scalablity up to 512 Processors:
Particles dP = 0.3 mm
FixMeshSurfaceStressServo::FixMeshSurfaceStressServo(some arguments) :
FixMeshSurfaceStress(some arguments),
xcm_(*mesh()->prop().addGlobalProperty< VectorContainer<double,3> >
("xcm","comm_none","frame_invariant","restart_yes",3)),
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 34
LIGGGHTS+CFDEMcoupling
Maintainablility
Clean-up of force kernels, every model is then located in exactly one file
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 35
IV.
Applications: Iron/Steelmaking
LIGGGHTS+CFDEMcoupling
BF and Corex Process
The production of hot metal via a traditional route involves a sinter plant, a coke
oven plant and a blast furnace The SIMETAL Corex® process represents an
alternative process to the blast furnace where these units are substituted by
one single unit. In this process, a wide variety of coals (non-coking coals) as
well as iron oxides, such as
lump ores, pellets and sinter
are used in a continuous
process, consisting of two
steps (reduction shaft and
melter gasifier)
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 37
LIGGGHTS+CFDEMcoupling
Calibration and Validation
Calibration
angle of repose, drop test, shear cell, friction test, shape recognition...
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 38
LIGGGHTS+CFDEMcoupling
Calibration and Validation
Case A B C
dp,1(mm) 4 4 6
Hoppers Guiding plates
Dorifice,1(mm) 38 38 38
Compartiments
dp,2 (mm) 3.15 3.15 2.65
Dorifice,2 (mm) 34 22 34
A B C
mass fraction
compartment compartment
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 39
LIGGGHTS+CFDEMcoupling
Impact of Charging Patterns
PHASE I
Calculation of Particle Charging
Particle Size Distribution governed 1:1
PHASE II
Calculation of Bed Formation
Particles are „coarse grained“
Cohesive Zone
dead
man Raceway
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 40
LIGGGHTS+CFDEMcoupling
Blast Furnace
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 43
LIGGGHTS+CFDEMcoupling
Case Study: Chute Abrasion
f ( i ) 1 / 3 cos ( i ) , tan( i ) 1 / 3 ,
2
tc ,1
EM 2 k f hs (u p
c n ) sin( 2 i ) u p f p - w f ( i ) dt .
tc , 0
E erosion rate
kf material dependent model parameter EM Eroded Mass
up particle velocity hs Heaviside function
γ impact angle fp-w particle-wall contact force
f dependency on impact angle cn particle-wall distance vector
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 44
LIGGGHTS+CFDEMcoupling
Pneumatic Conveying Erosion
animation
simulation
wear
field experiment
wear
angle (°)
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 45
LIGGGHTS+CFDEMcoupling
Excavator Simulation
Transport equation for passive dust phase Source term for passive dust phase
u pa D diff S T
3
C rp u f
t ST
V cell
u pa u f
Assumptions:
- coupling between phases is strong
- loading of the secondary phase << 1
Hilton, J.E. and Cleary, P.W. (2011):
treated as passive phase “Dust Dispersal Modelling on a Conveyor Chute
using a Coupled Discrete Element and CFD
Manninen, M. (1996): On the mixture model Method”, 8th International Conference on CFD in
for multiphase flow, VTT Publications 288, Oil & Gas, Metallurgical and Process Industries,
Technical Research Centre of Finland SINTEF/NTNU, Trondheim Norway, 21-23 June 2011
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com
LIGGGHTS+CFDEMcoupling
Transfer Chute Dust Emission
*.stl geometry,
velocity profile
DEM particles,
dust iso-surfaces
Measurement Chute F
Measurment Chute A
Simulation Chute A
Simulation Chute F
Chute A: Chute F:
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com
LIGGGHTS+CFDEMcoupling
Transfer Chute Dust Emission
Cross wind
entrains dust Dust is sucked
from transfer-chute into transfer-chute
Publications:
Kloss, C., Goniva, C., Katterfeld, A.: Simulation of wear and dust emission at a transfer chute; Cement International, 2012 (10), 2-9
measurem.data from: Chen, X.L., Wheeler, C.A., Donohue, T.J., McLean, R., Roberts, A.W.: Evaluation of dust emissions from conveyor
transfer chutes using experimental and CFD simulation. International Journal of Mineral Processing 110– 111 (2012) pp. 101– 108
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 49
IV.
z=0.10
z=0.05
Variation of
Geometry:
measurement
positions
z=0.10
z=0.05
Variation of
Parcel Approach:
Usf = 0.6077 m/s, dp=0.5mm, nParticles=1.4e6, 50 mm
h/h0 db/b
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com
IV.
Further Applications
& Case Studies
LIGGGHTS+CFDEMcoupling
Agricultural Engineering
Optimized setup (right): particles are smoothely given into gas stream
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 55
LIGGGHTS+CFDEMcoupling
Multi-Phase Flow Applications
(1)
R
(1) Suzzi et al. (2010):“Local analysis of the tablet coating process: Impact of
operation conditions on film quality“,CES,65,5699-6715
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 56
LIGGGHTS+CFDEMcoupling
Spray Coating
Physics to be covered
Spray modelling
Spray-particle interaction
Spray modelling
Equation of Motion
dv D G (vG v D ) vG v D Spray-particle interaction
mD g ( D G )V D C d , D A D
dt 2
t
f f u f 1
f f u f u f f f p f f g
K sf u f u p
t | 1 |
1
1 f u f 1 (1 1 ) u c 1
f
t t
Particle, „fluid mixture“ based drag
F d
K sf
i
V cell u f u p
d
2
u f u p u f u p C d
1 1
Fd
p
2 4
1- αf particle phase volume fraction
uf fluid velocity
τ, p stress tensor, pressure G. Wierink: A Computational Framework for Coupled
f,p fluid/particle density Modelling of Three-Phase Systems with Soluble Surfactants,
Ksf fluid solid momentum exchange term PhD thesis, Aalto University, 2012
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 58
LIGGGHTS+CFDEMcoupling
Minerals Processing
Floatation cell macro-scale model: Two-Phase Euler Model + DEM
Main Assumption: Bubbles are not resolved particles see mixture
Navier-Stokes equations for each fluid phase “f” in presence of a granular phase “s”
f f
f f u f 0
t
f uf
f f u f u f f p f f g M f f f fs
f
f
t
u u p u u p C d
1 1
Fd
p
ffs fluid solid momentum exchange term
2 4
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 59
LIGGGHTS+CFDEMcoupling
Minerals Processing
Macro-scale Model: Two-Phase Euler Model + DEM
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com 60
LIGGGHTS+CFDEMcoupling
River Bed Erosion
turbulent lift force is essential; best performance with Zanke (2003) model
Publications:
Batch processes: Bin flow, Forberg twin paddle mixer, Plow mixer, Fukae vertical
shear mixer, V-blender, Ribbon blender, Rotating drum
Download at http://cfdem.dcs-computing.com/media/DEM/benchmarks/LIGGGHTS_Benchmarks.pdf
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com
V.
Conclusions
LIGGGHTS+CFDEMcoupling
Conclusions
Open source simulation software is driven by the
applications, rules
of market apply
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com
LIGGGHTS+CFDEMcoupling
Conclusions
Open source simulation software is driven by the
applications, rules
of market apply
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com
LIGGGHTS+CFDEMcoupling
Conclusions
Open source simulation software is driven by the
applications, rules
of market apply
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com
LIGGGHTS+CFDEMcoupling
Conclusions
Open source simulation software is driven by the
applications, rules
of market apply
CFDEMproject: Department of Particulate Flow Modelling, JKU Linz and DCS Computing, Linz www.cfdem.com
VI.
Acknowledgements
Thanks to LAMMPS dev team
(Steve, Paul, Axel and others)
In alphabetical order: