text:
These are patches designed to improve system responsiveness and interactivity with specific emphasis on the desktop, but suitable to any commodity hardware workload. Apply to 3.5.x: http://ck.kolivas.org/patches/3.0/3.5/3.5-ck1/patch-3.5-ck1.bz2 or http://ck.kolivas.org/patches/3.0/3.5/3.5-ck1/patch-3.5-ck1.lrz Broken out tarball: http://ck.kolivas.org/patches/3.0/3.5/3.5-ck1/3.5-ck1-broken-out.tar.bz2 or http://ck.kolivas.org/patches/3.0/3.5/3.5-ck1/3.5-ck1-broken-out.tar.lrz Discrete patches: http://ck.kolivas.org/patches/3.0/3.5/3.5-ck1/patches/ Latest BFS by itself: http://ck.kolivas.org/patches/bfs/3.5.0/3.5-sched-bfs-424.patch Web: http://kernel.kolivas.org Code blog when I feel like it: http://ck-hack.blogspot.com/ This is a resync from 3.4-ck3. However, the broken out tarballs above also include the upgradeable rwlocks patch, and a modification of the global runqueue in BFS to use the urwlocks. These are NOT applied in the -ck1 patch, but can be applied manually at the end of the series as indicated by the series file. It is currently of no demonstrable performance advantage OR detriment in its current state, but is code for future development. Enjoy! お楽しみください -- -ck
A development blog of what Con Kolivas is doing with code at the moment with the emphasis on linux kernel, MuQSS, BFS and -ck.
Thursday 16 August 2012
3.5-ck1, BFS 424 for linux-3.5
117 comments:
- Anonymous16 August 2012 at 15:27
Judging from this post http://ck-hack.blogspot.com/2012/06/upgradeable-rwlocks-and-bfs.html it looks like I can avoid urw-locks.patch since I only have a 4-core cpu, right?
ReplyDelete - Anonymous16 August 2012 at 22:43
Hi Con,
very thanks to keep up with new linux release!
A little question: By diffing old 3.4 bfs-424 with this new one I saw you having done a lot regarding NUMA. This is at virtual level managing multiple cpus?
I have a system: x86_64 Intel(R) Core(TM)2 Duo
Is following NUMA .config acceptable, does it make sense?
# CONFIG_AMD_NUMA is not set
# CONFIG_NUMA_EMU is not set
Greetings from Germany,
Ralph UlrichRepliesIt's all to keep in sync with mainline, nothing more. I'd suggest you just turn NUMA off.
Delete- Anonymous16 August 2012 at 23:35
linux-3.5.2-bfs-with-NUMA just started, works! Thank you for the suggestion to turn NUMA off. What motivated me at first with NUMA is this help text:
CONFIG_NUMA: Enable NUMA (Non Uniform Memory Access) support.
For 64-bit this is recommended if the system is Intel Core i7
(or later), AMD Opteron, or EM64T NUMA
I think my processor has EM64T. Now I will try a compile session without NUMA config!
Ralph Ulrich - Anonymous17 August 2012 at 00:29
Yeah, linux-3.5.2-bfs-without-NUMA feels like a little performance boost. Although my extra virtualbox modules got an increase in size. I didn't try virtualbox with new Bfs enabled kernel yet.
Ralph Ulrich
--- linux-3.5.orig/kernel/sched/bfs.c
+++ linux-3.5/kernel/sched/bfs.c
@@ -5977,8 +5977,6 @@ static int __init isolated_cpu_setup(cha
__setup("isolcpus=", isolated_cpu_setup);
-#define SD_NODES_PER_DOMAIN 16
static const struct cpumask *cpu_cpu_mask(int cpu)
return cpumask_of_node(cpu_to_node(cpu));Thanks CK! As usual, here are the results of my make benchmark on my dual quad machine. CK1 clearly differentiates itself from mainline with n=27 runs doing a `make -j16 bzImage` on v3.5.2.
Here is a link to my benchmark script:
1) It is a non-latency based measure.
2) Compilation benchmark using gcc to "make bzImage" for a preconfigured linux 3.4.4 build.
3) Runs benchmarks 28 times totally to get a decent number of observations for a statistical comparison. In all cases, the first run is omitted leaving an n=27.
4) Results are how many seconds it took to compile on a dual Intel E5620 (2x hyperhreaded quadcore CPUs on a single board) @ 2.40 GHz.
5) Make is run with 16 threads (8 physical cores and 8 HT cores).
Just to correct a mistake I made before at this url:
I benchmarked mainline against mainline through a mistake of not uncommenting the lines in my script that patch the kernel source with your patchset. So, bfs still reigns supreme. Rock on.RepliesSorry, I have a question. What is the meaning of 'n=27'? And will the option '-j 16' make any difference to the kernel? It seems that it will not. Thanks in advance.
Delete@kelvin - n=27 means that I repeated the make benchmark 27 times to get a good number of observations on which to basis the statistics. Without a larger set, we cannot say that kernel A is faster than kernel B for example.
I use a -j16 switch because the machine has 8 physical cores and 8 hyperthreaded cores. It was selected to maximize throughput.
Hope that makes sense.Repeated same experiment on my new 3770K (hyperthreaded quad @ 4.5 GHz).
Thanks for your reply. The resolution of the benchmark for your new Ivy Bridge CPU(wow, a great CPU which is quite expensive!) is too low.
It seems that the faster the CPU, the greater the difference between the mainline kernel and ck-patched kernel.
- Anonymous17 August 2012 at 07:38
Dunno, seems like radeon driver is broken with 3.5.2 (3.5.1 from openSUSE +inc patch +BFS +BFQ +BFQ-Addon). radeon makes mess instead of working and fills the logs!
So, I cannot talk with you about 3.5.x :-(
But, Con, also from my side: A great "Thank you!" for the new patches!
Manuel KrauseReplies- Anonymous17 August 2012 at 19:10
Hi Manuel,
just today I see there coming two big radeon patches:
All you have to do, after git clone:
ln -s /usr/src/git/stable-queue/queue-3.5 /usr/src/linux/patches
cd /usr/src/linux && quilt push -a
Greetings from Hamburg, Ralph Ulirch - Anonymous17 August 2012 at 19:19
Excuse me:
Ralph Ulrich - Anonymous18 August 2012 at 02:25
So, the above mentionned setup, just with 3.4.9 instead of 3.5.2 is running fine. (But only 3h of uptime so far.)
Thank you, Ralph! At least for the news that there may be coming something hopefully better for radeon. I have no experience with git so far and don't know if I need to learn in. (Me = being very lazy atm) ;-) Don't mind.
Manuel - Anonymous18 August 2012 at 03:34
BTW. ... I kept/altered some of your recently proposed kernel config settings:
CONFIG_RCU_BOOST_PRIO=1 <--- giving a "-2" in top
and left
CONFIG_HZ_1000=y <---------- following Cons advices for interactivity
(Some of your options are not relevant for UP single core systems so: not mentioned, just to be complete.)
Too sad that these parameters including scheduler choice still aren't runtime-configurable.
Seems like with either 3.4.9 or the BFQ-addon patch
I do not need to further fiddle with schedtool to fight video/audio playback hickups on my weak old system.
- Anonymous17 August 2012 at 21:20
Just wondering. Do schedtool still needed with the current bfs version ?
ReplyDeleteRepliesSchedtool was never "needed". It is purely an optional feature an works the same on BFS as it always has.
Delete- Anonymous18 August 2012 at 05:49
Of course, never "needed" by design, as Con wrote.
But it's still a nice and handy tool to adjust priorities of certain processes within the BFS schema when the kernel / application & combination shows glitches.
E.g., I recently used these two on kernel 3.4.7:
schedtool -R -p 1 -n -10 `pidofproc pulseaudio`
schedtool -I -n -5 `pidofproc Xorg`
These haven't solved the issue of sound stalls with pulseaudio while playing video, but eased them at least (In my subjective scale counting -5 to +5: changed from -5 to -1.)
(And, please, also read the schedtool manpage for detailed understanding.)
Manuel Krause
Hi people
2 error after fix patch for 3.6.0-rc2
Patch for 3.5 kernel need to fix sched.h lines.
and error in kernel 3.6-rc2 :
First error in sched.h
init/init_task.c:16:32: error: expected expression before 'do'
make[4]: *** [init/init_task.o] Error 1
make[4]: *** Waiting for unfinished jobs....
CC kernel/printk.o
init/main.c:704:2: warning: data definition has no type or storage class [enabled by default]
init/main.c:704:2: warning: type defaults to 'int' in declaration of 'print_scheduler_version' [-Wimplicit-int]
init/main.c:704:2: warning: function declaration isn't a prototype [-Wstrict-prototypes]
init/main.c:704:2: error: conflicting types for 'print_scheduler_version'
In file included from include/linux/cgroup.h:11:0,
from include/linux/perf_event.h:582,
from include/linux/ftrace_event.h:8,
from include/trace/syscall.h:6,
from include/linux/syscalls.h:78,
from init/main.c:16:
include/linux/sched.h:1638:6: note: previous declaration of 'print_scheduler_version' was here
make[4]: *** [init/main.o] Error 1
make[3]: *** [init] Error 2
make[3]: *** Waiting for unfinished jobs....
after comment line : void print_scheduler_version(void);
next error :
init/init_task.c:16:32: error: expected expression before 'do'
VDSOSYM arch/x86/vdso/vdso-syms.lds
make[4]: *** [init/init_task.o] Error 1
AS arch/x86/realmode/rmpiggy.o
CC mm/filemap.o
LD arch/x86/vdso/built-in.o
LD arch/x86/realmode/built-in.o
make[3]: *** [init] Error 2
make[3]: *** Waiting for unfinished jobs....
CC mm/page_alloc.o
CC mm/page-writeback.o
CC mm/readahead.o
CC kernel/sched/bfs.o
LD arch/x86/built-in.o
CC mm/swap.o
kernel/sched/bfs.c: In function 'cpuset_cpu_active':
kernel/sched/bfs.c:6956:3: error: too few arguments to function 'cpuset_update_active_cpus'
In file included from kernel/sched/bfs.c:56:0:
include/linux/cpuset.h:23:13: note: declared here
kernel/sched/bfs.c: In function 'cpuset_cpu_inactive':
kernel/sched/bfs.c:6968:3: error: too few arguments to function 'cpuset_update_active_cpus'
In file included from kernel/sched/bfs.c:56:0:
include/linux/cpuset.h:23:13: note: declared here
make[5]: *** [kernel/sched/bfs.o] Error 1
make[4]: *** [kernel/sched] Error 2
make[3]: *** [kernel] Error 2
CC mm/truncate.o
best regards
m.- Anonymous18 August 2012 at 21:07
After a few days experience:
linux-3.5.2-bfs is the fastest kernel I ever had!
Without any errors nor problems!
With previous releases I had to
CONFIG_RCU_BOOST_PRIO > default one
as a workaround to not get process time overflows with top tool. This error isn't any more!
And thank you CK for advice to disable NUMA!
Ralph Ulrich - Anonymous19 August 2012 at 11:29
ck.kolivas.org is down, Saturday, 8/18/12. I was just about to try the new patch. :( ;)
Galen Seaman I can confirm too that disabling NUMA is beneficial for desktop systems. Just look at the results of the make benchmark that I wrote about earlier in this blog. Here you see the mainline "3.5.2-1-ARCH" vs. two different BFS patched kernels. One has NUMA enabled per the Arch Linux defaults and the other has it disabled:
There is a clear and statistically significant difference in compile times (n=28) with the median gain through disabling NUMA being 344 ms. From my research, unless your hardware has >1 PHYSICAL CPUs -- not cores but physical processors -- it is advantageous to disable NUMA as measured by this non-latency endpoint.
Thoughts?RepliesShould have mentioned that the above results on are an Intel 3770K @4.5 GHz running with 8 threads.
Delete- Anonymous19 August 2012 at 20:42
NUMA is about memory in relation to cpu.
- only cpu cache?
- all several physical cpu profit from NUMA?
- why is this NUMA .config enabled for nearly all big distros? Excellent question, Anon.
If all major distros do something because their peer group did it, this is a shameful reason to perpetuate it -- particularly considering the data showing that it is a performance regression for those users with only one physical CPU. In other words, if 99.99999 % of distro users have only one physical CPU (home users/laptop users) and thus are impacted detrimentally by this option, why in the world would we enable the option in the kernel package that benefits the 0.00001 % of users that do? Just because our peer groups do it is no justification that it is a data-driven and sound decision.
I made this very point to the Arch Linux kernel devs in a feature request. Let's see if they agree... https://bugs.archlinux.org/task/31187Or in other words, "turn this flag off for a kernel that's 0.3% faster on desktops, but massively slower on large machines!"
The server hosting ck.kolivas.org was migrated. All the files were lost. I've had to drag out what I could from backups so a lot's missing...
ReplyDeleteReplies- Anonymous19 August 2012 at 20:45
github, gitorious, launchpad, googlecode
all of them provide professional hosting backup included ... I prefer bitbucket.org. It offers unlimited space for open source project like a clone kernel git tree.
Hi, ck,
After I apply bfs for 3.5 last weekend for a machine which I happen to enable some kernel hacking option in kernel config, I got a WARNING and a suspicious RCU usage in dmesg, then I trac back to kernel 3.3 and also tested on other machine, the issue still there, I believe it is a long existed issue. I post the dmesg here and attached one of the kernel config of my machine.
[ 0.039032] ------------[ cut here ]------------
[ 0.040008] WARNING: at kernel/sched/bfs.c:1063 set_task_cpu+0x7a/0xe0()
[ 0.041003] Modules linked in:
[ 0.042005] Pid: 0, comm: BFS/0 Not tainted 3.5.2+ #44
[ 0.043003] Call Trace:
[ 0.044007] [] warn_slowpath_common+0x6b/0xa0
[ 0.045004] [] warn_slowpath_null+0x15/0x20
[ 0.045906] [] set_task_cpu+0x7a/0xe0
[ 0.046005] [] ? debug_check_no_locks_freed+0x96/0x160
[ 0.047004] [] ? trace_hardirqs_on+0xd/0x10
[ 0.048004] [] ? lockdep_init_map+0x65/0x150
[ 0.049005] [] ? ktime_get_ts+0xa8/0xe0
[ 0.050004] [] sched_fork+0x2d/0x1c0
[ 0.051004] [] copy_process+0x69e/0x12c0
[ 0.052004] [] do_fork+0x5c/0x320
[ 0.053003] [] ? sched_clock_local+0x25/0x90
[ 0.054004] [] ? trace_hardirqs_off+0xd/0x10
[ 0.055003] [] ? local_clock+0x4f/0x60
[ 0.056004] [] ? _raw_spin_unlock_irqrestore+0x5d/0x70
[ 0.057004] [] kernel_thread+0x6c/0x70
[ 0.057908] [] ? repair_env_string+0x5b/0x5b
[ 0.058003] [] ? gs_change+0xb/0xb
[ 0.059004] [] ? rcu_scheduler_starting+0x20/0x60
[ 0.060003] [] rest_init+0x21/0x160
[ 0.061003] [] start_kernel+0x2ca/0x2d7
[ 0.062002] [] ? kernel_init+0x198/0x198
[ 0.063002] [] x86_64_start_reservations+0xff/0x104
[ 0.064002] [] x86_64_start_kernel+0xed/0xf4
[ 0.065045] ---[ end trace 778bdcd3ab492196 ]---Replies[ 0.066142] DMAR: Host address width 36
[ 0.067009] DMAR: DRHD base: 0x000000feb03000 flags: 0x0
[ 0.068016] IOMMU 0: reg_base_addr feb03000 ver 1:0 cap c9008020e30260 ecap 1000
[ 0.069001] DMAR: DRHD base: 0x000000feb01000 flags: 0x0
[ 0.070020] IOMMU 1: reg_base_addr feb01000 ver 1:0 cap c0000020630260 ecap 1000
[ 0.071001] DMAR: DRHD base: 0x000000feb02000 flags: 0x1
[ 0.072014] IOMMU 2: reg_base_addr feb02000 ver 1:0 cap c90080206f0460 ecap 1000
[ 0.073001] DMAR: RMRR base: 0x000000000e0000 end: 0x000000000effff
[ 0.074001] DMAR: RMRR base: 0x000000be000000 end: 0x000000bfffffff
[ 0.076146] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.087064] CPU0: Intel(R) Core(TM)2 Duo CPU L9400 @ 1.86GHz stepping 06
[ 0.088992] Performance Events: PEBS fmt0+, 4-deep LBR, Core2 events, Intel PMU driver.
[ 0.089003] ... version: 2
[ 0.089995] ... bit width: 40
[ 0.090994] ... generic registers: 2
[ 0.091995] ... value mask: 000000ffffffffff
[ 0.092994] ... max period: 000000007fffffff
[ 0.093994] ... fixed-purpose events: 3
[ 0.094994] ... event mask: 0000000700000003
[ 0.104000] lockdep: fixing up alternatives.
[ 0.104907] Booting Node 0, Processors #1 Ok.
[ 0.100081] CPU1: Thermal monitoring handled by SMI
[ 0.118028] Brought up 2 CPUs
[ 0.118996] Total of 2 processors activated (7447.89 BogoMIPS).
[ 0.120146]
[ 0.120988] ===============================
[ 0.120988] [ INFO: suspicious RCU usage. ]
[ 0.120988] 3.5.2+ #44 Tainted: G W
[ 0.120988] -------------------------------
[ 0.120988] kernel/sched/bfs.c:7054 suspicious rcu_dereference_check() usage!
[ 0.120988]
[ 0.120988] other info that might help us debug this:
[ 0.120988]
[ 0.120988]
[ 0.120988] rcu_scheduler_active = 1, debug_locks = 1
[ 0.120988] 1 lock held by BFS/0/1:
[ 0.120988] #0: (&grq.lock){-.....}, at: [] sched_init_smp+0xf6/0x286
[ 0.120988]
[ 0.120988] stack backtrace:
[ 0.120988] Pid: 1, comm: BFS/0 Tainted: G W 3.5.2+ #44
[ 0.120988] Call Trace:
[ 0.120988] [] lockdep_rcu_suspicious+0xe5/0x130
[ 0.120988] [] sched_init_smp+0x180/0x286
[ 0.120988] [] kernel_init+0x86/0x198
[ 0.120988] [] ? schedule_tail+0x8c/0x110
[ 0.120988] [] kernel_thread_helper+0x4/0x10
[ 0.120988] [] ? retint_restore_args+0xe/0xe
[ 0.120988] [] ? repair_env_string+0x5b/0x5b
[ 0.120988] [] ? gs_change+0xb/0xb
[ 0.147393] PM: Registering ACPI NVS region [mem 0xb94c0000-0xb94cffff] (65536 bytes)
[ 0.148991] PM: Registering ACPI NVS region [mem 0xbd4df000-0xbd6defff] (2097152 bytes)
[ 0.151014] PM: Registering ACPI NVS region [mem 0xbd9cf000-0xbdacefff] (1048576 bytes)
[ 0.152991] NET: Registered protocol family 16
kernel config @ https://github.com/cchalpha/kernelconfig/blob/master/x200/x200-3.5.2-gc.configAs I look at the code, grp lock seems not been held in do_fork -> copy_process -> sched_fork. I am not familiar with these codes, plz have a check, ck.
DeleteThanks. That does indeed look wrong, but the way the data is locked in bfs it won't lead to a problem. I may correct it next version just so the warning won't happen.
DeleteThanks ck for the quick reply. I forgot to tell that this cause no trouble, at lease from 3.3 to 3.5 on all machines I used, but it should be good to fix such warning.
- Anonymous21 August 2012 at 23:00
Just a notice about systemd:
Although it is mentioned BFScheduler doesnt work with cgroup, this just means you are unable to manipulate the scheduler using cgroups. But
Systemd plays well with .config having:
# CONFIG_CGROUP_DEBUG is not set
# CONFIG_CGROUP_MEM_RES_CTLR_KMEM is not set
# CONFIG_CGROUP_PERF is not set
# CONFIG_DEBUG_BLK_CGROUP is not set
# CONFIG_CFQ_GROUP_IOSCHED is not set
# CONFIG_NETPRIO_CGROUP is not set
I am just trying systemd-188
Ralph UlrichRepliesUsing OpenSuse 12.1 with systemd and zen Kernel (with BFS and BFQ). Was much simpler than your way on gentoo ;)
No problem here, my .config differs:
# CONFIG_CGROUP_MEM_RES_CTLR is not set
# CONFIG_CGROUP_PERF is not set
Don't wan't to miss systemd, nice to see how simple you can see the boot time graph for the different deamons. Und how quick you can tweak the boot process. Maybe some time BFS don't work together with systemd (as I read, systemd tries to expand to a kind of super user space deamon, big brother for all tasks, with resource management), but at the moment there is no problem so far.
Btw. On OpenSuse my shutdown time was dramatically reduced with systemd too.
Mike- Anonymous27 August 2012 at 01:02
@Mike, I am pretty sure
- you run systemd-44 with consolekit
- BFS enabled linux kernel does not affect systemd
My tries are about newest systemd-189 with advanced features. openSUSE-12.2 will not update to newer systemd ...
Ralph Ulrich @Ralph,
no, still on 37 with OpenSuse 12.1 ;)
Hope, that OpenSuse Tumbleweed will update to newer systemd, or I must wait another year for OpenSuse 12.3 :D
PS: Nice to see, that systemd evolves so quick, but that is another story, hope that BFS will support it.
- Anonymous3 September 2012 at 05:17
@Ralph Ulrich, et al.,
some weeks ago you suggested settings for the RCU subsystem. Some of them for non-UP systems (so: not for my machine). Some of them as a workaround for you in those days.
That was:
CONFIG_RCU_BOOST_PRIO=14 (workaround)
Do you have insights or experience with the last one, to share with us?
I've already googled the world but did not find a clue. This setting does have an important influence on I/O vs. interactivity/responsiveness.
Currently I'm running 3.5.3 with BFS + BFQ +BFQ-Addon @ 1000HZ & CONFIG_RCU_BOOST_DELAY=333. ATM, I can only say that this favours disk I/O a bit with unchanged responsiveness compared to default(500). Worst cases to test with: Writing files to NTFS partitions via ntfs-3g and playing video in parallel; and watchout for stuttering audio/video.
Manuel KrauseReplies- Anonymous3 September 2012 at 23:31
Isn't ntfs-3g going a fuse way of IO? I am not sure this is approached with RCU?
By the way my settings of RCU_BOOST were a workaround for linux-3.4 kernel. My current linux-3.5.3-bfs works well and without error using default setting!
Ralph Ulrich - Anonymous4 September 2012 at 08:03
Yes, ntfs-3g is working via fuse. But I don't know at all how this corresponds/interacts to/with RCU. Perhaps someone else can explain?
Thanks for your immediate reply! :-))) After reading that, I should try the default settings with next kernel compile again.
Manuel Krause
- Anonymous17 September 2012 at 06:33
Please, excuse me for this off-topic posting. But I expect Linux specialists to come back on here that possibly know, on how to help me.
Issue: I've upgraded from openSUSE 12.1 to 12.2 3 days ago. With that change I got from gcc 4.6.2 to 4.7.1. But with that I don't get the same kernel compiled in the same way. It does not call the PM resume sequence any more after suspend to disk & later poweron.
If I use the old 3.5.3-BFS kernel compiled with 12.1/4.6.2 everything works fine.
Does someone of you know any clue?
Manuel KrauseReplies- Anonymous17 September 2012 at 06:50
Also, the new (4.7.1) kernel cannot keep the timezone any more. The old one does.
Manuel Krause - Anonymous18 September 2012 at 06:29
Weird thing!!! [SOLVED]
Wrong way: I even installed the old gcc 4.6.3 + required libs and recompiled the kernel(s).
Right way: Reinstall the needed package (named "suspend" on openSUSE + packages it depends on)
Possible reason: Uninstalling too much of the plymouth related fancy shiny stuff and systemd.
Shame on me for bothering you all with that!
But also really many thanks for not answering, so I finally achieved to elaborate it @ my own!
Manuel Krause
in case anyone wants to apply BFS 4.24 to 3.6.0-rc5: i made the following patch (without intrinsic knowlegde of the code, so it may not be perfect). It compiles, boots, and has been stable since then, but is otherwise untested. ;)
http://www.filefactory.com/file/4uo5xkecax3x/n/3_6-sched-bfs-424_patch- Anonymous21 September 2012 at 08:56
Have semantics of cpuset_update_active_cpus been changed?
---- linux-3.5-ck1/kernel/sched/bfs.c
++++ linux-3.6-rc5/kernel/sched/bfs.c
+ switch (action & ~CPU_TASKS_FROZEN) {
+ case CPU_ONLINE:
+ case CPU_DOWN_FAILED:
-+ cpuset_update_active_cpus();
++ cpuset_update_active_cpus(true);
@@ -6952,7 +6952,7 @@
+ switch (action & ~CPU_TASKS_FROZEN) {
+ case CPU_DOWN_PREPARE:
-+ cpuset_update_active_cpus();
++ cpuset_update_active_cpus(false);
Ralph Ulrich - Anonymous28 September 2012 at 21:36
A queued fix for coming linux-3.5.5 will break bfs-424 in include/linux/sched.h:
Because concerned new code is never to be used with BFScheduler it will be an easey - just reorder patch - fix to do. As Martin above pointed out, beside the change with cpuset_update_active_cpus, this is also the only case to change with linux-3.6-rc. So we wait for a new common ground:
Ralph Ulrich - Anonymous30 September 2012 at 18:53
I tried bfs on a shaved lowjitter 3.5.4 kernel. Chromium makes ubuntu 12.04 unstable with it. Read also http://paradoxuncreated.com/Blog/wordpress/?p=3226
Peace Be With You. CK - seems as though upstream changed something in include/linux/sched.h that causes ck1 [bfs] patch to fail:
patching file arch/powerpc/platforms/cell/spufs/sched.c
patching file Documentation/scheduler/sched-BFS.txt
patching file Documentation/sysctl/kernel.txt
patching file fs/proc/base.c
patching file include/linux/init_task.h
Hunk #1 succeeded at 141 (offset 9 lines).
Hunk #2 succeeded at 269 (offset 10 lines).
patching file include/linux/ioprio.h
patching file include/linux/sched.h
Hunk #3 FAILED at 1240.
Hunk #4 succeeded at 1360 (offset 3 lines).
Hunk #5 succeeded at 1596 (offset 3 lines).
Hunk #6 succeeded at 1671 (offset 3 lines).
Hunk #7 succeeded at 2055 (offset 3 lines).
Hunk #8 succeeded at 2771 (offset 3 lines).
1 out of 8 hunks FAILED -- saving rejects to file include/linux/sched.h.rej
Any quick fixes?RepliesAck... meant to include that this is in going from 3.5.4 --> 3.5.5!
https://git.kernel.org/?p=linux/kernel/git/stable/linux-stable.git;a=commit;h=4f83989550ace0aa91464051cbaddc10e1b85778> Any quick fixes?
depends on your workflow. I'd apply the vanilla kernel diff to 3.5.4-ck1. This will result in 1 failed hunk in sched.h. I would then manually apply the following (note: garbled whitespace):
--- include/linux/sched.h.3.5.5.broken 2012-10-03 15:06:42.858278393 +0200
+++ include/linux/sched.h 2012-10-03 15:14:50.841213062 +0200
@@ -1265,6 +1265,9 @@
struct sched_entity se;
struct sched_rt_entity rt;
+#ifdef CONFIG_CGROUP_SCHED
+ struct task_group *sched_task_group;
#ifdef CONFIG_PREEMPT_NOTIFIERS
/* list of struct preempt_notifier: */
I verified it compiles, but I haven't installed the kernel yet.
Resync of sched-bfs-424 with linux-3.5.5
First apply 3.5-sched-bfs-424.patch on top of linux-3.5.5 although it doesn't apply cleanly. Then apply this patch:
http://www.file-upload.net/download-6651389/resync-sched-bfs-424-with-linux-3.5.5-_sid_.patch.htmlRepliesSeems as though the git patch I posted above is the cause of this... thank you for your work, but I don't think in this case, that it is needed.
Link to patch:
https://bugs.archlinux.org/task/31778?getfile=9421- Anonymous4 October 2012 at 03:48
@ _sid_
no! Steps are:
1. patch-3.5.5 on top of linux-3.5.0 source
2. reverse-patch - you can find here:
3. apply 3.5-sched-bfs-424.patch
Ralph ULrich - Anonymous4 October 2012 at 21:15
Big discussion about
because Gentoo maintainers are special bound to their upstream. And perhaps the feature to disable BFS as the scheduler ist kind of a flaw ?
Ralph ULrich @graysky, Ralph:
My instructions to create a bfs patched kernel on top of linux-3.5.5 work perfectly here (uptime 1 day). BTW, the kernel created that way is identical to Martin's one.
Unfortunately, BFSv424 ported to 3.6 doesn't compile:
kernel/sched/bfs.c: In function 'update_rq_clock_task':
kernel/sched/bfs.c:2290:2: error: implicit declaration of function 'static_branch' [-Werror=implicit-function-declaration]
cc1: some warnings being treated as errors
make[2]: *** [kernel/sched/bfs.o] Помилка 1
make[1]: *** [kernel/sched] Помилка 2
make: *** [kernel] Помилка 2
make: *** Очікування завершення завдань...
===- Anonymous5 October 2012 at 14:08
Come on Ck, bring up a new patch for 3.6. Even BFQ is faster for this kernel relaese!
ManuelRepliesSorry, a family tragedy has kept me mostly offline. There will still be some delay before I can sync up with 3.6.
Delete- aCOSwt5 October 2012 at 17:30
Don't be sorry ck ! We are !
Take care of your family, everybody here can wait !
Those who can't are not human => They can't wait but they will and nobody cares.
Wishes for courage and strength !
Eric - Anonymous5 October 2012 at 17:32
Sorry for this difficult time your family is going through. And don't worry, computer software is not THAT important, we can wait.
Delete - Anonymous5 October 2012 at 18:49
Yes, take care of your family and best wishes from Hamburg,
Ralph ULrich - Anonymous6 October 2012 at 11:00
Dear Con,
I'm really sorry. If had known that before, I wouldn't have written this initial posting.
I do not depend on your patchset, but originally and generally, wanted to let you know that we appreciate your ongoing work.
Take your time. My best wishes are with you!
- Anonymous5 October 2012 at 20:40
You raise-max patch seems to be going in the wrong direction for desktop. I have found 90hz to give optimal jitter in OpenGL. Which pretty much translates to a well-running system. You can try my low-jitter kernel here: http://paradoxuncreated.com/Blog/wordpress/?p=2268
PS: This is not -ck. Cfs gave less jitter i OpenGL. I like cfs granularity also, and have set it to a suitable value.
Peace Be With You.Replies- Anonymous6 October 2012 at 01:45
Therefor servers only use 100hz also: longer periods of uninterrupted tasks,calculating - do need less context switches! All over better performance!
If you run a less powered computer or a high demanding task (gaming) you experience this fact!
Ralph Ulrich - Anonymous8 October 2012 at 10:21
Excellent post, Ralph Ulrich. Actually you are the first poster in twenty, that actually understand this. Ofcourse on servers many understand this. On desktop, there seems to be few who understand this, and higher hz, and suboptimal configs are much more common there. (for instance 250hz, no preempt, liek a standard ubuntu kernel - mindless.) It seems to be similar people that argue many services/drivers on windows, and tubeamp/vinyl in audio, or similar things.
Peace Be With You.
I played with kernel 3.6 today and I found that the BFs 424 patch for 3.6-rc5 I posted previously still applies to 3.6. I have also made a ck1 patch available here:
The usual big disclaimer: I have simply adapted the existing coding so that it compiles and runs on 3.6 (posting this from a running 3.6-ck1 kernel). I am not in a position to maintain the actual semantics of the coding. That is Con's prerogative.
Further good news: the BFQ patch for 3.5 applies to 3.6 as well.Replies- Anonymous7 October 2012 at 08:47
Thank you for providing interim patches for us in the meantime!
I want to bug-report that (at least) the latest BFS-only patch you made is not uniprocessor friendly. Only capable of SMP.
What I've found so far is: It's related to the changes you've made in the patch regarding include/linux/shed.h (HUNK 3 @@ -1239,17 +1244,36 @@)
ATM I don't really know how to fix this. Any advices?
Thank you in advance,
Manuel Krause
Appendix: Compiling error output:
CC kernel/sched/bfs.o
kernel/sched/bfs.c: In function 'task_running':
kernel/sched/bfs.c:467:10: error: 'struct task_struct' has no member named 'on_cpu'
kernel/sched/bfs.c: In function 'sched_fork':
kernel/sched/bfs.c:1742:3: error: 'struct task_struct' has no member named 'on_cpu'
kernel/sched/bfs.c: In function 'schedule':
kernel/sched/bfs.c:3314:7: error: 'struct task_struct' has no member named 'on_cpu'
kernel/sched/bfs.c:3315:7: error: 'struct task_struct' has no member named 'on_cpu'
kernel/sched/bfs.c: In function 'init_idle':
kernel/sched/bfs.c:5010:6: error: 'struct task_struct' has no member named 'on_cpu'
kernel/sched/bfs.c: In function 'task_running':
kernel/sched/bfs.c:468:1: warning: control reaches end of non-void function [-Wreturn-type]
make[2]: *** [kernel/sched/bfs.o] Error 1
make[1]: *** [kernel/sched] Error 2
make: *** [kernel] Error 2 hmm. thanks for the feedback. The on_cpu error is easy enough to fix (and, i have to admit, was unnecessarily introduced by myself). However, when testing UP configurations I hit on another problem in the context of urwlocks which I can't get my head around so easily. I'm afraid that one is left to the man himself...
In other words: for SMP configurations my previous patch works fine, but for UP I have no real solution yet.
just for the crack of it I have uploaded the corrected versions (with respect to cpu_on), in case someone wants to have a go at the locks for UP.
http://www.filefactory.com/file/3epahpsasjwz/n/patch-3.6-ck1.bz2Replies- Anonymous8 October 2012 at 09:14
Thank you for the corrections. And you're right, _my_brain_ wasn't capaple to fix it myself yesterday even if it was such an easy fix.
3h uptime now with my usual workloads un my UP-only machine
@ kernel 3.6.0 + fixed 424 BFS + mm-drop_swap_cache_aggressively.patch + most recent BFQ-v5
I don't want to add confusion - but for correctness - I only replaced the failing patch hunk (as reported) in Martins weeks ago patch with the corrected sequence from his today's patch.
Thank you very much!
Manuel Krause Thanks for porting the ck patch to 3.6. I'm running just fine with it on my quad core machine. Arifhn, I compiled 3.6.1 with patch-3.6-ck1.bz2 using gcc-4.7.2. What's your kernel config look like?
Delete@Martin - Thanks for working on the unofficial ck1 and bfs patchsets. Filefactory and captha are lame. I would be glad to mirror your patches on http://repo-ck.com which houses the unofficial Arch Linux-CK packages.
http://repo-ck.com/PKG_source/testing/unofficial_patchset_from_martin/3.6-sched-bfs-424.patch...did you know that Oleksandr Natalenko merged your unofficial bfs into his linux-pf patchset? Quite an honor :)
http://pf.natalenko.name/@Martin - Good job with these patches as measured by my standard make benchmark comparing identically configured kernels with and without the patchset.
Benchmark details:
As you see, the -ck patched kernel clearly differentiates itself from mainline with n=28 runs doing a `make -j8 bzImage` on v3.6.1.
Here is a link to my benchmark script:
1) It is a non-latency based measure.
2) Compilation benchmark using gcc to "make bzImage" for a preconfigured linux 3.6.1 build.
3) Runs benchmarks 28 times totally to get a decent number of observations for a statistical comparison.
4) Results are how many seconds it took to compile on a 3370K @ 4.5 GHz.
5) Make is run with 8 threads (4 physical cores and 4 HT cores).hey grayski,
thx for benchmarking the patch. That's a good indication that nothing got horribly broken. Btw, I am still looking for a benchmark measuring the "desktop fluidity" or -- to translate a word invented by German c't magazine -- the "swoopdicity" of a system. At least that's where I feel the benefits of BFS.
Thanks also for pointing out O. Natalenko's site. cool stuff.
And yes, from my side there is no problem hosting the patches elsewhere. I just used the first file hoster Google would find. It's all in the cloud anyway. ;)> ...did you know that Oleksandr Natalenko merged your unofficial bfs into his linux-pf patchset? Quite an honor :)
Guys, stop that. I just merge patches made by other people and *I must* say "thanks" to all of them. Not they to me.
- Anonymous9 October 2012 at 22:57
there is a problem
init/init_task.c:16:8: error: unknown field 'deadline' specified in initializer
init/init_task.c:16:8: error: unknown field 'run_list' specified in initializer
init/init_task.c:16:32: error: 'struct task_struct' has no member named 'run_list'
init/init_task.c:16:32: error: 'struct task_struct' has no member named 'run_list'
init/init_task.c:16:8: error: unknown field 'time_slice' specified in initializer
make[2]: *** [init/init_task.o] Errore 1
make[1]: *** [init] Errore 2 @Martin - Both of your patches compiles up just fine when I build using a subset of modules; if I build trying to use the official ARCH config files (linked below), my build errors out:
Any advice?
https://projects.archlinux.org/svntogit/packages.git/tree/trunk/config.x86_64?h=packages/linuxReplieshmmm. unfortunately irq time accounting is a bit out of my league. I think we need Con's expertise here.
kernel/sched/bfs.c: In function 'update_rq_clock_task':
kernel/sched/bfs.c:2394:2: error: implicit declaration of function 'static_branch' [-Werror=implicit-function-declaration]
cc1: some warnings being treated as errors
CC [M] crypto/pcbc.o
make[2]: *** [kernel/sched/bfs.o] Error 1
make[1]: *** [kernel/sched] Error 2
make: *** [kernel] Error 2
make: *** Waiting for unfinished jobs....
Please replace static_branch function call with static_key_false function call and have a fun.@post-factum - Can you please upload the BFS in your patchset broken-out? Did you do this replacement that you suggested?
> @Martin - Both of your patches compiles up just fine when I build
> using a subset of modules; if I build trying to use the official ARCH
> config files (linked below), my build errors out:
> ...
An update. It seems the build errors ONLY occurs when I build having guest virtualization enabled. If I disable it, I can build the _full set_ of modules just fine using the ck1 patch Martin provided.
[ ] Processor type and features --->Paravirtualized guest support --->
wtf?one problem after build kernel 3.6.1 with Martin patch system not boot. after remove patch system boot normal.
m.Replies- Anonymous13 October 2012 at 11:42
Please supply more information!
Do you receive errors during patch application and/or kernel compilation?
And, when booting, do you receive messages you can provide to us?
With your posting you're leaving us digging in the dust of Mars.
Manuel - Anonymous14 October 2012 at 11:47
I use the opensource radeon for my graphics. When going to a new kernel I often have to reboot at least twice.
First reboot may lead to a blank/black/striped screen. But keyboard control is active after 40s. So I usually can login blindly and do the reboot (avoiding disk loss compared to RESET-button).
Please also try the new patches from CK,
Manuel Krause
- Anonymous13 October 2012 at 11:13
So, I had been running openSUSE kernel 3.6.1 with my old setup (most recent BFS-only from Martin + mm-drop_swap_cache_aggressively.patch + most recent BFQ, UP-system) for over 2 days of uptime without any problems. {Please keep in mind, that the BFS-patch always needs minor adjustments for openSUSE kernel-sources.}
Maybe something like that has hit Micron? (I always watch the patching output before make and compilation output before rebooting^^ !)
Then, I tested the ck1 provided by Martin and it failed compiling after a few minutes. Error output at the end. I then reverted bfs424-grq_urwlocks.patch from Con's broken-out (http://ck.kolivas.org/patches/3.0/3.5/3.5-ck1/patches/) and it compiled fine and is up and running since this afternoon without issues.
Best regards,
Manuel Krause
Error Output:
CC kernel/sched/bfs.o
In file included from kernel/sched/bfs.c:72:0:
include/linux/urwlock.h: In function '__urw_write_lock':
include/linux/urwlock.h:42:2: error: implicit declaration of function 'arch_write_lock' [-Werror=implicit-function-declaration]
include/linux/urwlock.h: In function '__urw_write_unlock':
include/linux/urwlock.h:48:2: error: implicit declaration of function 'arch_write_unlock' [-Werror=implicit-function-declaration]
include/linux/urwlock.h: In function '__urw_read_lock':
include/linux/urwlock.h:54:2: error: implicit declaration of function 'arch_read_lock' [-Werror=implicit-function-declaration]
include/linux/urwlock.h: In function '__urw_read_unlock':
include/linux/urwlock.h:60:2: error: implicit declaration of function 'arch_read_unlock' [-Werror=implicit-function-declaration]
cc1: some warnings being treated as errors
make[2]: *** [kernel/sched/bfs.o] Error 1
make[1]: *** [kernel/sched] Error 2
make: *** [kernel] Error 2 - Anonymous4 November 2012 at 23:55
I have tried now both BFS and CFS, with the most possible low-jitter tweaks. My impression is that on jitter-sensitive applications like Doom 3, they can perform very similar. On additional compatibility layers like wine, who are even more jitter sensitive, BFS jitter-extremes seem higher. Meaning average jitter is lower, but wine has some 1 second jitters, with BFS. CFS has higher average jitter, but no 1 second jitters.
Both tested with high_res_timers off, 90hz timer, and a fast granularity setting for a psychovisual jitter-profile of natural.
Peace Be With You.


text:
Concho Resources Inc (CXO:NYS): Analytics, Extensive Financial Metrics, and Benchmarks Against Averages and Top Companies Within its Industry
Concho Resources Inc (CXO:NYS): Analytics, Extensive Financial Metrics, and Benchmarks Against Averages and Top Companies Within its Industry
Key Findings:
Unique new report provides deep financial benchmarks for Concho Resources Inc (CXO:NYS) compared to its top competitors and compared to the average for all companies within its primary industry.
Benchmarking study for Concho Resources Inc (CXO:NYS) includes growth forecast for its primary industry to the year 2028. The purpose of this report is to provide vital corporatespecific benchmarks, comparing the Subject Company to its top competitors (on a companybycompany basis) and to the averages within its primary industry for all key metrics.
This is a unique report containing highvalue data. The report begins with a superb overview of the primary industry of the Subject Company, including historical industry revenues, revenue forecasts and CAGR. Then the report moves into industry averages and metrics, then into data specific to the Subject Company, with comparative data for the Subject Company's top competitors.
This report will save countless hours of research and analytical work for the end user.
Core Benefits to Customer:
1) Comprehensive benchmarks for the Subject Company:
a. Benchmarked against the leading firms in its primary industry
b. Benchmarked against the average for publiclyheld companies (U.S.) in its industry.
c. This includes financial results, ratios, vital statistics and metrics in one package, including historical and current metrics and averages for 6 years within its primary industry.
2) A snapshot overview of the company's primary industry, including current and historic revenues and employment, along with a long term forecast for industry growth, with CAGR (compound annual growth rate), employee population and much more.
3) Detailed rankings of the Subject Company against top companies within the industry (U.S.based firms) for key items including:
a. Approximate market capitalization
b. Employees
c. Revenues
d. Net income
e. 3Year revenue growth (%)
f. 3Year income growth (%)
g. Return on assets (%)
h. Return on equity (%)
i. Return on invested capital (%)
4) Leading companiesprofiles of the Subject Company as well as profiles of top competitors within the industry
Pages: 80
Statistical Tables Provided: 28
Charts Provided: 14
Geographic: US
This report is part of the Plunkett's Corporate Benchmarks series, published by the Plunkett Analytics unit of Plunkett Research, Ltd. Plunkett Research has unique capabilities for creating corporate and industry information, due to the industry and company research that we have been conducting for more than 20 years. Our access to hundreds of industry tables from our own databases, along with our databases of public and private company information, industry trends analysis and other resources, have been utilized in preparing this report. Similar reports are available for all significant, U.S. publiclyheld firms.
Designed to benefit:
Analysis and Financial Modeling
Investment Professionals
M&A Advisors
"Plunkett Research has built a solid reputation providing industry analysis and research in a diverse spectrum of areasenergy and utilities, finance and investment, health care and biotechnology, and engineering and research to name a few." American Reference Books Annual
Learn how to effectively navigate the market research process to help guide your organization on the journey to success.
Download eBook

subset: commoncrawl


text:
If you are looking for a trending shirt, no need to worry, we have covered you back with this t-shirt. Don't miss the chance! Come and grab one gift for you or your friend. 100% satisfaction guaranteed. Visit Drama Shirt for other trendy t-shirts, home decor, and other awesome products!
I'm Just Here For The Drinks Hoodie Lilo & Stitch
Browse through our category Disney, White T-shirt and choose what you like. From corporate to casual, from movies to music, from comics to love, and from cute to funny. There is something for everyone. Check out the description for the I'm Just Here For The Drinks Hoodie Lilo & Stitch here below
Product Description
– Material: Cotton
– Color: Printed in a Variety of Colors
– Size: Sizes vary from S to 5XL (depending on style)
– Style: Unisex Tees, Unisex V-necks, Unisex Hoodies, Long Sleeve Tees, Sweatshirts, Men's Tank Tops, Women's Racerbacks, and others.
– Origin: Made in the United States
– Care Instructions:
- Wash with similar colors in a warm, inside-out machine.
- Only use bleach that is free of chlorine.
- Tumble drying at a medium temperature.
- Do not dry clean or iron.


text:
Commercial Speed Queen SC80SN3 Washer-Extractor Parts
Find commercial Speed Queen SC80SN3 washer replacement or repair parts fast at Alliance Laundry Systems, the largest worldwide supplier of Speed Queen commercial laundry parts for washer and dryer repair service. When you purchase genuine Speed Queen SC80SN3 washer parts at Alliance Laundry Systems, you can trust you are buying a Genuine Part that is backed with industry-leading support and commercial laundry & laundromat expertise. Search our commercial Speed Queen SC80SN3 replacement parts list by part number, by model number, or by part description. We offer same day shipping for in-stock online Speed Queen SC80SN3 washer parts ordered before 4PM Pacific Time (business days only).
We offer the best quality Speed Queen genuine parts, to ensure your Speed Queen commercial laundry machines will function properly.


text:
Shipping & ReturnsIN-STORE Returns Policy
Because you were able to touch, feel, and try on for fit and size, shoes and clothing may be exchanged or returned for store credit within seven (7) business days of purchase with original receipt. No cash, check, or credit card refunds will be given. All items returned must have been purchased from Monkee's of Mount Pleasant. Returned items must be unworn with price tags intact. Handbags, sunglasses, jewelry, lingerie, hats, accessories, home & gifts, special orders, trunk show items, orders shipped outside of the US and items discounted 20% or more are FINAL SALE and cannot be exchanged or returned for a store credit.
ONLINE Returns Policy
We want you to LOVE your purchase! We will happily accept returns postmarked within 10 days of purchase on unworn, new products with tags attached. Customers may use pre-paid shipping label to return items (US ONLY). If used, $5 will be deducted from the return. Refunds will be made to the card used in the original transaction. All Monkee's boutiques are independently owned and operated, so we can only accept returns on purchases from this store location. Handbags, sunglasses, jewelry, lingerie, hats, accessories, home & gifts, special orders, orders shipped outside of the US and discounted items 20% or more are FINAL SALE and cannot be refunded, exchanged or returned for a store credit. Shoes must be returned in their original box and the box must be in good condition.
*PLEASE NOTE: If you used any free shipping coupon code at checkout and return your order, we will complete the return, less $5 to cover the shipping.
As a small business, we can not accommodate every return but we will be reasonable. Please contact us directly with any questions or concerns.
If you need to return an item, simply login to your account, view the order using the "Complete Orders" link under the 'My Account' menu and click the Return Item(s) button. We'll notify you via e-mail of your refund once we've received and processed the returned item.
Shipping Policy
Standard Shipping
We offer standard ground shipping within the U.S. for a flat rate fee of $5.00, unless otherwise indicated. Orders over $200 qualify for complimentary standard ground shipping with the code FREESHIP. When your order ships, you will receive an email including tracking information so you can keep an eye out for your package. Delivery times and dates will vary based on your location. We are not responsible for unforeseen delays due to holidays and weather.
*PLEASE NOTE* Any order that was shipped for free, and is later returned will be subject to a $5 shipping charge taken from the refund amount to cover the original cost of shipping.
Expedited Shipping
We offer expedited two day shipping within the U.S for a flat rate fee of $25. Please select expedited shipping at checkout. Orders submitted Monday - Friday by 2pm EST will ship the same day.
No Overnight Shipping is offered at this time.
Not all of our inventory is sold online due to vendor restrictions. Please follow us at @monkeesmp to call to order!
This crewneck sweater is made from featherweight cashmere so it's perfect for effortless everyday wear. Designed with drop shoulders and roll trims, the relaxed-fitting style hits at the high hip for a leisurely look. Match your accessories to the contrasting stripes.
- Relaxed fit
- Long sleeve
- Length in size small is 21".
- The model is 5'10 1/2" and is wearing a size small.
- 100% Cashmere.
- Dry clean only.
*Follow @monkeesmp to stay up to date with the latest styles. All try ons are saved to our highlights!**Want to see more pictures or have a question about fit? Shoot us a text at 843-870-7993.


text:
WASHINGTON » Sexual assaults in the military are a growing epidemic across the services and thousands of victims are still unwilling to come forward despite a slew of new oversight and assistance programs, according to a new Pentagon report.
Troubling new numbers estimate that up to 26,000 military members may have been sexually assaulted last year, according to survey results released against a backdrops of scandals including an ongoing investigation into more than 30 Air Force instructors for assaults on trainees at a Texas base
The report was released today and comes just days after the Air Force's head of sexual assault prevention was arrested on charges of groping a woman in a Northern Virginia parking lot. And it follows a heated debate over whether commanders should be stripped of the authority to overturn military jury verdicts, such as one officer did in a recent sexual assault conviction.
In a sharp rebuke today, President Barack Obama said he has no tolerance for the problem and that he had talked to Defense Secretary Chuck Hagel about it. He said any military member found guilty of sexual assault should be held accountable, prosecuted and fired.
"I don't want just more speeches or awareness programs or training, or ultimately folks look the other way," the president said. "We're going to have to not just step up our game, we have to exponentially step up our game to go after this hard."
Hagel later gave a grim assessment, saying the military "may be nearing a stage where the frequency of this crime and the perception that there is tolerance of it could very well undermine our ability to effectively carry out the mission and to recruit and retain the good people we need."
The documents show that the number of sexual assaults actually reported by members of the military rose 6 percent to 3,374 in 2012. But a survey of personnel who were not required to reveal their identities showed the number of service members actually assaulted could be as many as 26,000, but they never reported the incidents, officials said Tuesday.
That number is an increase over the 19,000 estimated assaults in 2011.
The statistics highlight the dismal results that military leaders have achieved in their drive to change the culture within the ranks, even as the services redoubled efforts to launch new programs to assist the victims, encourage reporting and increase commanders' vigilance.
Hagel ordered a series of steps and reviews to increase officers' accountability for what happens under their commands, and to inspect workstations for objectionable materials, according to memos and documents obtained by the AP.
Hagel also told military leaders to develop a method to assess commanders and hold them accountable on their ability to create a climate "of dignity and respect." He has given commanders until July 1 to visually inspect workspaces to make sure they are free of degrading materials, and military leaders have until Nov. 1 to recommend ways to assess officers and hold them accountable for their command climates.
"Sexual assault is a crime that is incompatible with military service and has no place in this department," Hagel said in a new response plan the department will release today. "It is an affront to the American values we defend, and it is a stain on our honor. DoD needs to be a national leader in combating sexual assault and we will establish an environment of dignity and respect, where sexual assault is not tolerated, condoned, or ignored."
While the latest cases involve Air Force members, the problem extends across all the military services.
Across Capitol Hill, lawmakers demanded the Pentagon take more aggressive steps to address the growing problem and they announced renewed efforts to pass legislation to battle the problem.
"When our best and our brightest put on a uniform and join the United States Armed Forces, they do so with the understanding that they will sacrifice much in the name of defending our country and its people. However, it's unconscionable to think that entertaining unwanted sexual contact from within the ranks is now part of that equation," said Sen. Patty Murray, D-Wash. "Not only are we subjecting our men and women to this disgusting epidemic, but we're also failing to provide the victims with any meaningful support system once they have fallen victim to these attacks."
This week's sexual battery arrest of Air Force Lt. Col. Jeffrey Krusinski, who headed the Air Force Sexual Assault Prevention and Response unit, provided a rallying point for lawmakers, who held it up today as an example of the Pentagon's failure to make progress despite the increased effort.
Sen. Carl Levin, D-Mich., told Air Force officials at a Senate Armed Services Committee hearing today that "while under our legal system everyone is innocent until proven guilty, this arrest speaks volumes about the status and effectiveness of (the Defense) department's efforts to address the plague of sexual assaults in the military."
Members of Congress are putting together legislation to essentially strip military officers of the authority to overturn convictions for serious offenses such as sexual assault. The measure stem from congressional outrage over an Air Force officer's decision to reverse a jury verdict in a sexual assault case.
Rep. Mike Turner, R-Ohio, Sen. Kirsten Gillibrand, D-N.Y., and others are drawing up legislation that likely will be included in the annual defense policy bill that will essentially strip military officers of the authority to overturn convictions for serious offenses such as sexual assault.
Separately, Murray and Sen. Kelly Ayotte, R-N.H., introduced legislation today to provide victims with a special military lawyer who would assist them throughout the process, prohibit sexual contact between instructors and trainees during and within 30 days of completion of basic training or its equivalent and ensure that sexual assault response coordinators are available to help members of the National Guard and reserve.
Turner said the increase in assaults and the failure of so many victims to come forward shows that "much more needs to be done both legislatively and structurally, to root out this problem."
According to Pentagon documents, the key conclusion of the report is that "sexual assault is a persistent problem in the military and remains vastly underreported."
The report says that of the 1.4 million active duty personnel, 6.1 percent of active duty women — or 12,100 — say they experienced unwanted sexual contact in 2012, a sharp increase over the 8,600 who said that in 2010. For men, the number increased from 10,700 to 13,900. A majority of the offenders were military members or Defense Department civilians or contractors, the report said.
Within the specific services, the Army showed a 16 percent decrease in the number of reported sexual assault cases, from 1,695 in 2011 to 1,423 in 2012.
The Navy said it saw a 32 percent increase, jumping from 550 in 2011 to 726 in 2012. The report said the Marines had more than a 30 percent increase in reported sexual assaults, from 333 in 2011 to 435 in 2012. And the Air Force had a 33 percent increase in reports, from 594 in 2011 to 790 in 2012.
Military and defense officials said to a degree they view an increase in reporting as a somewhat positive move since it indicates that victims are becoming more willing to come forward and have faith in the military justice system.
Gen. Mark Welsh, the Air Force's chief of staff, told the Senate Armed Services Committee that he and Air Force Secretary Michael Donley were "appalled" by the charges against Krusinski.
"As we have both said over and over and over again, sexual assault prevention and response efforts are critically important to us," Welsh said. "It is unacceptable that this occurs anywhere, at any time, in our Air Force."
Welsh said that while the Krusinski case is being adjudicated by the Arlington County, Va., prosecutor, the Air Force has requested jurisdiction. He said Krusinski will be arraigned Thursday on one count of sexual battery and that an Arlington County prosecutor will decide the jurisdiction question.
Sen. Claire McCaskill, D-Mo., one of the most vocal critics of the military's efforts to stop sexual assaults, pressed Welsh on what qualifications Krusinski had for the job and whether Welsh reviewed his personnel file since his arrest to see if there were any red flags.
Welsh said he found nothing irregular in Krusinski's file.
Associated Press writer Richard Lardner contributed to this report.


text:
Karup's Private Collection is one of the biggest porn archives in the world, with only the highest quality videos and millions of high resolution, hardcore and softcore photos! Enjoy our free samples and join today for much more with our fully unlimited download access!
This text will be replaced
All of our videos are offered in many formats so you will be able to watch them on your computer or your mobile device. You can watch them online, stream them from our lightning fast servers, or download them to your computer or mobile device and watch them later.
There are no limits, no restrictions, and no DRM. Only pure, high quality content served just the way you like it!


text:
GobelinL Printed Tapestry Canvas - "Portrait boy with dog".
You are looking at a full color printed canvas only, from GobelinL. This will need to be stitched using a good quality Embroidery Floss, a full recipe of required shades and quantities is printed on the canvas for both Anchor and DMC Embroidery Floss. The design is full color printed on Zweigart 10 count double thread Antique canvas (4 threads/cm), and should be worked using half cross stitch with tapestry yarn.
GobelinL (Diamant) is one of Europe's oldest brands of printed Tapestry Canvases and their designs are both scenic and cultural. They also have many designs of classic art paintings. These canvases have been produced using the traditional screen printing process, with multiple passes, to create a design which is like 'Art on Canvas'.
The item will be shipped banded to fit an envelope.
Key Product Features:
- Made in EU(Greece) on 100% cotton penelope canvas.
- Dimensions: 16"x20" 40x50cm full size.
- Canvas: Antique 4 treads/cm.
- The 20 colors guide chart for Anchor and DMC.
- Embroidery Floss are printed on the sides of canvas. Embroidery floss/yarn are not included.
Thanks for looking.


text:
Wedding Suppliers in Sale
It can be challenging to narrow down your search for the best wedding suppliers and venues in Sale. Which is why we've done it for you… Below you'll find a curated list of Wedding Suppliers in Sale, chosen by the team at Rock My Wedding. With over a decade of industry experience you can be safe in the knowledge you are only choosing from the most stylish Wedding Suppliers in Sale.
You'll get all the info you need from each listing, including photos, real wedding features and contact details. You can also contact your wedding suppliers or venues directly from the listings below to make gathering quotes and checking availability quick and easy.
Rock My Wedding is the UK's most popular planning resource so you know we've got good taste. And you do too, that's why you're here.
No Ads. Just weddings.
Rock My Wedding is the UK's most popular and innovative wedding planning resource, providing future brides and grooms with informative planning advice and styling inspiration. We are 100% sponsorship free which means all of our reviews and recommendations are unbiased. You will find talented and unique industry suppliers via our Recommended Suppliers.
Join our intuitive online platform where you can log in for free, favourite articles and use our wedding planning checklist. We also have a pro-planet, pre-loved marketplace aptly called Recycle My Wedding. Oh and we also have a podcast. And a book.
With hundreds of thousands of readers and over 1.3 million followers across social media we help engaged couples all over the world to plan their day their way.
We want you to have a marriage even more beautiful than your wedding.
Love always wins.
If you're a supplier, you can apply to join Recommended here.


text:
Have Questions? Ask an Expert.
Low Cost Shipping
On All Orders
In-House Experts
We know our products
Purchase In Store
Ecocig Vapour Store, 15 Birdgate,
Pickering, YO18 7AL -
🔞 Over 18's Only
You Must Be 18 or Over
to Purchase This Product.
Chuffed - 100ml - Cherry Menthol
Out of stock
Chuffed - Cherry Menthol - The perfect mixture of juicy sweet cherries and menthol.
Bottle Size: 100ml
Strength: 0mg
Chuffed - Cherry Menthol - The perfect mixture of juicy sweet cherries and menthol.
Bottle Size: 100ml
Strength: 0mg
Delivery to the UK is £2.50. Dependant on the size and weight of the order, the order will be dispatched with either Royal Mail or DPD Local to UK Mainland. You can find out more information on our delivery page at the bottom of the page.
Vegetable Glycerin (VG) is a thick, sweet liquid. VG produces luscious clouds of vapor. VG also imparts a sweeter taste to your liquid. Propylene Glycol (PG) is a much thinner tasteless liquid. PG produces more of a "throat hit" than VG does, which simulates the feel of smoking better.
Everyone is different! Some people like to puff away all day and other people like to stick to their designated 'vaping' breaks. As a rough guide, an average 20 a day smoker of traditional cigarettes gets through a 10ml bottle every 10 days or so.


text:
Metal Color: | Yellow Gold |
Metal Type: | 10k Gold |
Product Weight: | 17.80 Grams |
Width: | 4.60mm Wide |
Length: | 26 Inch chain + 4 Inches Bottom extension with cross |
10k Yellow Gold Hexagon Ball Bead Rosary Chain 26 Inch 4.6mm
"Make Your Best Offer" Making your best offer gives you the chance to negotiate the price with us. The advantage of a making an offer is that you have the opportunity to buy the item at a lower price than the advertised price.Only submit an offer when you are serious about purchasing the item. Please keep your offer at reasonable price or your offer will not be considered".
- Black Leatherette Jewelry Box
- 5 Month Diamond Jewelry warranty
- Jewelry Appraisal (Diamond jewelry priced over $300 only)
- USPS 3 Day Shipping (U.S.A. only)
- Insured Packages (U.S.A. only)
- Instant Phone Support (Your very own personal jeweler)
- Free Ring Sizing (Unless otherwise stated)
- Hassle Free 14 Day Return Policy
10am-7pm EST
1-718 -791 -4537
10am - 5pm EST
At So Icy Jewelry we offer the safety and convenience of local pick up which is available for all our customers. Not all items online are available at the showroom location. Local pick up is available by appointment only, Please call a representative to schedule an appointment.
Email Us: Our Location:55 west 47th street suite 1135
11th floor
New York NY 10036
Included with your purchase
Shipping Service | Shipping Fee | Shipping Time |
USPS Priority | $Free | 3-4 business days |
USPS Express | $25.00 | 1-2 business days |
Fedex Standard Overnight | $55.00 | Next Business Day PM delivery |
Fedex Priority Overnight | $60.00 | Next Business Day AM delivery |
- Orders placed by 11am EST will be shipped out the same day
- Orders placed after 11am EST will be shipped the following business day
- Orders are not shipped on holidays, Saturday or Sunday
- Signature is required for all items over $100
- Delivery of an order is possible on Saturday
- Same day shipping is only available for in-stock items and is not available for personalized, out of stock or back-order items.
- APO/FPO orders will ship via USPS Priority Mail only. (4-7 Business days delivery time)
- Alaska / Hawaii / US Territories must add an additional 1-2 business days for USPS shipping services
- To ensure fast shipping time please make sure you use your correct address at checkout, any order modifications/errors will delay shipping time.
- Sales tax of 8.875% is collected for orders shipped to New York state
- *All orders is subject to complete verification before shipment is made.
- Learn more about our shipping policy*
Shipping Service | Shipping Fee | Shipping Time |
Canada USPS Express | $50.00 | 7-10 business days |
WorldWide USPS Express | $60.00 | 7-10 business days |
Canada Fedex Overnight | $70.00 | 1-3 Business days |
Europe & Russia FedEx Priority | $100.00 | 3-5 Business Days |
United Kingdom FedEx Priority | $70.00 | 3-5 Business Days |
Australia FedEx Priority | $100.00 | 3-5 Business Days |
Japan FedEx Priority | $100.00 | 3-5 Business Days |
Middle East FedEx Priority | $110.00 | 3-5 Business Days |
All international orders maybe subject to taxes and duties fee by the customs office of the destination country. These additional charges required for customs clearance are the responsibility of the recipient. When your order arrives any fees will have to paid directly. Total fees range from approx 5-15% of total purchase price, depending on destination. Signature is required on all packages. Learn more about international shipping
If the item does not meet your every expectation you may return it for full refund within 14 days of receiving the item, Shipping charges are non refundable, Any item priced above $1000.00 will be subject to a 3% restocking fee which will be deducted from the total amount refunded. Items must be returned in the condition they were received in.
- Shipping charges are non refundable ( free shipping fee, $15.00 per package, will also be deducted from the total refund)
- Custom orders are not refundable
- Return shipping fees must be paid by customer
- Rings that have been sized will be subject to an additional $25.00 restocking fee, In some cases rings that have been sized are not eligible for return.
- Any items priced below $1000.00 will not be subject to a restocking fee.
Our Return Mailing Address:
So Icy Inc.55 West 47 street Suite #1135
New York NY 10036
Learn more information about our Return Policy
When shopping with So Icy Jewelry you can be certain that what you're buying is 100% authentic. We do not promote any counterfeit products on our website. Our fine jewelry will pass any industry standard testing for gold and diamonds.
Secure Shopping:
When you use your credit card to make a purchase through our shopping cart, the information you provide is protected by a 256 bit Secure Sockets Layer (SSL) encryption technology. This technology ensures that your personal information is protected from outside parties when transmitted from your computer to our server.
Learn more about Our Jewelry Products


text:
Phone Number
Email Address
Herbal Powder, Extracts & Herbal Tea Manufacturers And Exporters In India
Silver Roots has stepped into the niche to provide high-quality raw and processed herbs to Nutraceutical Industry, Phytochemical Industry, Extract Manufacturers, Ayurvedic Industry, FMCG Industry and more. Today, we are well-renowned as one of the best Moringa Tea Manufacturers In Simdega. We have attained this considerable success in a short span of time, and take all possible measures to keep it maintained.
All the products manufactured or extracted are as per the international standard of quality and pass through stringent tests before getting delivered for further processing. Besides keeping strict eyes on maintaining their quality, we pack them using high-quality material for better safety. Whether you want Ashwagandha Powder, Moringa Seeds, Moringa Leaves, Moringa Oil or Honey in Simdega, we are undeniably the one-stop to reach.
If you are still searching for one of the noteworthy Turmeric Exporters, Trader and Suppliers in Simdega, we are the one you can trust for getting your bulk needs fulfilled within a promised time frame. Drop us your direct requirements from the website or dial our number to get our direct assistance now.
Loaded with the most advanced manufacturing resources for maintaining quality and hygiene.
We directly source from farms to grow quality produce for us and to further deliver only the best.
We provide labelling with your company name and brand details as per your specific demands.
We are indeed the name you can trust for all your needs related to Moringa Seeds, Moringa Dried Leaves, Moringa Oil and Moringa Powder. Our consistent efforts have gained us credibility among the best Moringa Oil Manufacturers. You can count on our company for placing your bulk orders. We promise to meet that shortly.
We have a wide range of herbal products in our portfolio to cater to your distinct needs. Browse through our range and order now.
All ProductsYou can call us directly, or request a call back from our experts. We are right here to provide support and take this conversation ahead. We promise to maintain the confidentiality of your details.


text:
As you can see from the list of link topics below, Lewis Carroll's influence remains far-reaching today. His writings and ideas have sparked countless creative efforts of all kinds in all fields of the arts and sciences, all over the world. These links are only a sampling, but we hope you find them useful and instructive, not to mention entertaining.
Please note: All links provided on this site are for reference only, and do not necessarily represent an endorsement of a given site or its contents. If you know of additional links appropriate for this or any of our other pages, please send the link to us! We are always looking for new, good-quality links relating to Lewis Carroll.


text:
Name: | Ceroni, Dr Francesca |
Position : | Senior Lecturer |
Additional Roles: | Assistant Supervisor |
Department/Section: | Administration |
Division/Department: | Department of Chemical Engineering |
Faculty: | Faculty of Engineering |
Room: | 510A |
Floor: | 5th Floor |
Building: | ACE Extension |
Campus: | South Kensington Campus |
E-Mail: | email@example.com |
Professional Details: | http://www.imperial.ac.uk/people/f.ceroni |
The Imperial College Switchboard can be contacted on +44 (0)20 7589 5111.
If an individual is not listed in College Directory they will not be listed in the directory used by Imperial College's switchboard either, therefore switchboard will not be able to connect you.
Students are not listed in the directory used by the switchboard either so they will be unable to connect you.
If the entry above does not have a telephone number listed then Switchboard will not have that person listed.
If the entry does not have a telephone number listed, but there is an email address listed we recommend you email them as it is possible that they do not have a telephone line.
If you are having difficulty locating someone, the Imperial College switchboard may be able to put you through to someone in the same Faculty, Division or Department who may be able to help.


text:
Senate Races
The Republicans have 23 seats at stake in 2008 and the Democrats have just 12. Nevertheless, many of these are safe seats, so the numbers don't tell the whole story. Below are the races expected to be competitive. The map-generation software was never designed to handle two Senate races in the same state at the same time, so in Wyoming we are tracking only Sen John Barrasso's seat and in Mississippi only Sen Roger Wicker's seat. It is virtually certain that Sen Michael Enzi (R-WY) and Sen. Thad Cochran (R-MS) will be reelected as they won by huge majorities in 2002 and have weak opponents in 2008. For purposes of keeping score, Sen. Joe Lieberman (I-CT) and Sen. Bernie Sanders (I-VT) count as Democrats. If Lieberman speaks at the Republican convention, he might be booted out of the Democratic caucus in January, but for the time being he is de facto a Democrat. Click on a state for a graph of the polls for that race. Click here for a single page with all the senate graphs. See also our list of all 2008 Senate races and also the hottest 2008 House races. Alaska
New Hampshire
New Mexico
North Carolina
Back to the main page. |


text:
Hensol Castle Welsh Dry Gin
The jewel in the crown, from award winning Hensol Castle Gin. A traditional copper pot distilled London Dry gin. Juniper led, driven by hand-peeled citrus and our wildflower medley that's grown in the ground of our own castle. It's the perfect balance of spice and sweet botanicals, making this gin the perfect accompaniment with any mixer or cocktail.
70cl – 41% ABV
Delivery Information
- Orders received on weekdays will be dispatched within 24 hours if stock is available. We will contact you to discuss alternative arrangements if stock is not available and they they will/ can be shipped separately as soon as they become available.
Standard Delivery - This means that your goods will be processed as normal and shipped by Royal Mail 2nd Class or by another courier service for larger parcels. Ordered goods will usually arrive within 3-5 working days for most of the UK mainland.
UK DPD 1 Day Delivery (NOT WEEKENDS)
- If your order is made before 13.00, we will endevour to ship the available stock for the next working day. Where there has been a stock error we will let the cutomer know as soon as possible.
- If your order is made after 13.00pm we may be able to ship the same day but there is no guarantee and it will take 1 working days.
- Bank holidays will add an extra working day to the estimated delivery lead times.
Same Day Dispatch
Free delivery option
How do I select the free delivery option?
You can choose your delivery options in your Giftware Wales shopping basket and apply the qualifying code.
Will I receive my order any sooner if I pay for delivery?
- Yes - we process orders where priority dispatch has been paid for first.
- If you pay for priority dispatch, we will despatch the items we have in stock straight away with the remainder going onto back order. These items are despatched when they have all come into stock or after a week, whichever is sooner.
- If you select the free delivery option, we will dispatch all your items together when they are all in stock. If we are still waiting for items after a week, we will dispatch the ones we do have
What if I want some items really quickly?
Pay for priority dispatch in the normal way - that way, we'll despatch what we can as soon as we can. If any items are out of stock you will be informed as soon as possible.
What happens if an item in my order is delayed?
- We will wait for 5 days, then send the items we do have in stock. The remaining items will go onto back order.
- Items on back order will be dispatched as soon as they arrive with no delivery charge
UK Returns
Returns policy
At Giftware Wales, we strive to provide you with high-quality products and an exceptional shopping experience. We understand that sometimes you may need to return an item, and we want to make this process as straightforward as possible. Please review our returns policy carefully to ensure a smooth return process.
28-Day Money Back Guarantee
We proudly offer a 28-day no-quibble money back guarantee on nearly all items purchased from our online store. If you are not completely satisfied with your purchase, you can return it within 28 days of receiving your order for a full refund.
Exceptions to Returns
Health & Safety: In accordance with health and safety laws, we cannot accept returns for underwear items due to hygiene reasons.
- Custom Handmade Gold Rings: We do not offer refunds on hand-made-to-order gold rings in compliance with distance selling laws. Please ensure your order details are accurate before completing your purchase.
- Time Limit: No refunds or exchanges will be accepted beyond the 28-day return period.
Return Conditions
To qualify for a refund, please ensure the following conditions are met:
- The item(s) must be returned in their original, as-new condition.
- All tags must be attached to the item(s).
- The item(s) must be in their original packaging.
- Items that have been used, washed, soiled, or damaged will not be eligible for a refund.
- Engraved items can only be returned in case of an error made by us or the engravers.
International Returns
For international customers wishing to return items for exchange or refund, please note that you are responsible for covering the return shipping costs.
Cancellation Within 24 Hours
Orders cancelled within 24 hours of being placed may be subject to a 2.5% charge to cover credit card fees.
Return Fees
No return fees will be paid on returns of unwanted items when no fault lays with Giftware Wales.
Important Information
When communicating with us regarding returns, please make sure to include your name, contact details, and the original order number for efficient processing.
Return Slip
Include the return slip provided below with your return package.
Contact Us
If you have any questions or need assistance with your return, please do not hesitate to contact our Customer Services team.
Subscribe for Discounts
Sign up for our newsletter to receive a 10% discount code on all new subscriptions.
Thank you for shopping at Giftware Wales. We value your business and aim to provide you with exceptional products and service.
Giftware Wales
Personalised Items
There can be a delay of 1-2 days to dispatch PRINTED personalised items!
Size Chart
International Shipping
If you do not see your destination listed, please contact us for a shipping quote before you purchase.
Taxes may be due upon arrival at their destination shipping hub and will be charged to the customer before release.
Dispatch time
Under normal circumstances every order received (Monday to Friday) will be dispatched within 24 hours (week days) assuming the stock is available.


text:
King James Version
Ephesians 3
1 For this cause I Paul, the prisoner of Jesus Christ for you Gentiles,
2 If ye have heard of the dispensation of the grace of God which is given me to you-ward:
3 How that by revelation he made known unto me the mystery; (as I wrote afore in few words,
4 Whereby, when ye read, ye may understand my knowledge in the mystery of Christ)
5 Which in other ages was not made known unto the sons of men, as it is now revealed unto his holy apostles and prophets by the Spirit;
6 That the Gentiles should be fellowheirs, and of the same body, and partakers of his promise in Christ by the gospel:
7 Whereof I was made a minister, according to the gift of the grace of God given unto me by the effectual working of his power.
8 Unto me, who am less than the least of all saints, is this grace given, that I should preach among the Gentiles the unsearchable riches of Christ;
9 And to make all men see what is the fellowship of the mystery, which from the beginning of the world hath been hid in God, who created all things by Jesus Christ:
10 To the intent that now unto the principalities and powers in heavenly places might be known by the church the manifold wisdom of God,
11 According to the eternal purpose which he purposed in Christ Jesus our Lord:
12 In whom we have boldness and access with confidence by the faith of him.
13 Wherefore I desire that ye faint not at my tribulations for you, which is your glory.
14 For this cause I bow my knees unto the Father of our Lord Jesus Christ,
15 Of whom the whole family in heaven and earth is named,
16 That he would grant you, according to the riches of his glory, to be strengthened with might by his Spirit in the inner man;
17 That Christ may dwell in your hearts by faith; that ye, being rooted and grounded in love,
18 May be able to comprehend with all saints what is the breadth, and length, and depth, and height;
19 And to know the love of Christ, which passeth knowledge, that ye might be filled with all the fulness of God.
20 Now unto him that is able to do exceeding abundantly above all that we ask or think, according to the power that worketh in us,
21 Unto him be glory in the church by Christ Jesus throughout all ages, world without end. Amen.